2024-02-22T23:31:38.117901793Z . 2024-02-22T23:31:39.057947956Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-02-22T23:31:40.255761214Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-02-22T23:31:46.984132767Z [2024-02-22T23:31:46.982+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-02-22T23:31:47.988933919Z [2024-02-22T23:31:47.986+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-02-22T23:32:02.808164516Z 2024-02-22T23:32:03.688497451Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-02-22T23:32:05.263655456Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-02-22T23:32:11.309066724Z [2024-02-22 23:32:11 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-02-22T23:32:11.340359127Z [2024-02-22 23:32:11 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-02-22T23:32:11.340376374Z [2024-02-22 23:32:11 +0000] [16] [INFO] Using worker: sync 2024-02-22T23:32:11.389033546Z [2024-02-22 23:32:11 +0000] [17] [INFO] Booting worker with pid: 17 2024-02-22T23:32:11.390026317Z [2024-02-22 23:32:11 +0000] [18] [INFO] Booting worker with pid: 18 2024-02-22T23:32:13.549784799Z 2024-02-22T23:32:13.549807199Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-02-22T23:32:13.549812176Z --- ***** ----- 2024-02-22T23:32:13.549815724Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-02-22 23:32:13 2024-02-22T23:32:13.549818948Z - *** --- * --- 2024-02-22T23:32:13.549822292Z - ** ---------- [config] 2024-02-22T23:32:13.549826270Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f2e87512b60 2024-02-22T23:32:13.549829451Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-02-22T23:32:13.549832596Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-02-22T23:32:13.549839468Z - *** --- * --- .> concurrency: 16 (prefork) 2024-02-22T23:32:13.549843852Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-02-22T23:32:13.549848404Z --- ***** ----- 2024-02-22T23:32:13.549853130Z -------------- [queues] 2024-02-22T23:32:13.549857531Z .> default exchange=default(direct) key=default 2024-02-22T23:32:13.549862055Z 2024-02-22T23:32:13.549866225Z 2024-02-22T23:32:13.549869475Z [tasks] 2024-02-22T23:32:13.549872584Z . airflow.executors.celery_executor.execute_command 2024-02-22T23:32:13.549875825Z 2024-02-22T23:32:19.039067634Z [2024-02-22 23:32:19,034: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-02-22T23:32:19.051119784Z [2024-02-22 23:32:19,043: INFO/MainProcess] mingle: searching for neighbors 2024-02-22T23:32:20.064922271Z [2024-02-22 23:32:20,064: INFO/MainProcess] mingle: all alone 2024-02-22T23:32:20.091604266Z [2024-02-22 23:32:20,091: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-02-22T23:33:13.809270123Z [2024-02-22 23:33:13,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93776a5e-2075-4cc2-9ec8-68668f838a70] received 2024-02-22T23:33:13.862494801Z [2024-02-22 23:33:13,862: INFO/ForkPoolWorker-15] [93776a5e-2075-4cc2-9ec8-68668f838a70] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:33:14.299535571Z [2024-02-22 23:33:14,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:33:14.743136774Z [2024-02-22 23:33:14,740: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:33:45.475974134Z [2024-02-22 23:33:45,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93776a5e-2075-4cc2-9ec8-68668f838a70] succeeded in 31.664162594999993s: None 2024-02-22T23:33:56.368424056Z [2024-02-22 23:33:56,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cb41d8e-31cb-45fb-b615-cfbc9c531d53] received 2024-02-22T23:33:56.416453830Z [2024-02-22 23:33:56,415: INFO/ForkPoolWorker-15] [2cb41d8e-31cb-45fb-b615-cfbc9c531d53] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:33:56.859418197Z [2024-02-22 23:33:56,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:33:57.292033909Z [2024-02-22 23:33:57,275: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:34:28.012822177Z [2024-02-22 23:34:28,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cb41d8e-31cb-45fb-b615-cfbc9c531d53] succeeded in 31.641930656s: None 2024-02-22T23:34:28.885041108Z [2024-02-22 23:34:28,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50375f30-b8e8-47f2-986f-6da257db0d0a] received 2024-02-22T23:34:28.893227092Z [2024-02-22 23:34:28,892: INFO/ForkPoolWorker-15] [50375f30-b8e8-47f2-986f-6da257db0d0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:34:29.169477032Z [2024-02-22 23:34:29,166: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:34:29.430341266Z [2024-02-22 23:34:29,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:34:50.000456115Z [2024-02-22 23:34:49,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50375f30-b8e8-47f2-986f-6da257db0d0a] succeeded in 21.113312124000004s: None 2024-02-22T23:36:00.512251500Z [2024-02-22 23:36:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4618bc80-0388-4053-9663-1852ce797455] received 2024-02-22T23:36:00.529482535Z [2024-02-22 23:36:00,529: INFO/ForkPoolWorker-15] [4618bc80-0388-4053-9663-1852ce797455] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:36:00.831997187Z [2024-02-22 23:36:00,828: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:36:01.088525439Z [2024-02-22 23:36:01,088: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:36:01.649916608Z [2024-02-22 23:36:01,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4618bc80-0388-4053-9663-1852ce797455] succeeded in 1.133784326999944s: None 2024-02-22T23:38:01.096070883Z [2024-02-22 23:38:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[706c90f4-4df4-4cbd-b164-a036b2f4de75] received 2024-02-22T23:38:01.105812797Z [2024-02-22 23:38:01,105: INFO/ForkPoolWorker-15] [706c90f4-4df4-4cbd-b164-a036b2f4de75] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:38:01.394902269Z [2024-02-22 23:38:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:38:01.657089233Z [2024-02-22 23:38:01,656: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:38:02.331291344Z [2024-02-22 23:38:02,330: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[706c90f4-4df4-4cbd-b164-a036b2f4de75] succeeded in 1.233042623000074s: None 2024-02-22T23:39:36.314675001Z [2024-02-22 23:39:36,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e55182db-2301-4129-b407-bfa38c62e892] received 2024-02-22T23:39:36.326363441Z [2024-02-22 23:39:36,326: INFO/ForkPoolWorker-15] [e55182db-2301-4129-b407-bfa38c62e892] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:39:36.591060018Z [2024-02-22 23:39:36,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:39:37.716408130Z [2024-02-22 23:39:37,716: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:39:37.720184851Z [2024-02-22 23:39:37,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:39:37.742437455Z [2024-02-22 23:39:37,742: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:39:37.744327247Z [2024-02-22 23:39:37,743: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:39:37.744342435Z [2024-02-22 23:39:37,743: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:39:37.744347362Z [2024-02-22 23:39:37,743: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:39:37.744352011Z [2024-02-22 23:39:37,743: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:39:37.744355960Z [2024-02-22 23:39:37,744: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:39:37.744359879Z [2024-02-22 23:39:37,744: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:39:37.826061449Z [2024-02-22 23:39:37,825: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:39:38.485399606Z [2024-02-22 23:39:38,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e55182db-2301-4129-b407-bfa38c62e892] succeeded in 2.167761660999986s: None 2024-02-22T23:39:38.534009417Z [2024-02-22 23:39:38,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa42373-e939-421d-bd8d-b59ed6b6e949] received 2024-02-22T23:39:38.545732215Z [2024-02-22 23:39:38,545: INFO/ForkPoolWorker-15] [2fa42373-e939-421d-bd8d-b59ed6b6e949] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-22T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:39:38.847347450Z [2024-02-22 23:39:38,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:39:39.944235531Z [2024-02-22 23:39:39,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:39:39.952652157Z [2024-02-22 23:39:39,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:39:39.973146092Z [2024-02-22 23:39:39,972: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:39:39.974166695Z [2024-02-22 23:39:39,973: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:39:39.974208630Z [2024-02-22 23:39:39,974: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:39:39.974338477Z [2024-02-22 23:39:39,974: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:39:39.974380568Z [2024-02-22 23:39:39,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:39:39.974555185Z [2024-02-22 23:39:39,974: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:39:39.974599421Z [2024-02-22 23:39:39,974: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:39:40.059073398Z [2024-02-22 23:39:40,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:39:40.781383731Z [2024-02-22 23:39:40,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fa42373-e939-421d-bd8d-b59ed6b6e949] succeeded in 2.2455744080000386s: None 2024-02-22T23:39:40.899714809Z [2024-02-22 23:39:40,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fad0859-64ad-4659-8f27-52f416d9e309] received 2024-02-22T23:39:40.908053485Z [2024-02-22 23:39:40,907: INFO/ForkPoolWorker-15] [0fad0859-64ad-4659-8f27-52f416d9e309] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-22T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:39:41.187707969Z [2024-02-22 23:39:41,183: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:39:42.230858995Z [2024-02-22 23:39:42,230: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:39:42.233921552Z [2024-02-22 23:39:42,233: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:39:42.257575310Z [2024-02-22 23:39:42,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:39:42.259011576Z [2024-02-22 23:39:42,258: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:39:42.259076663Z [2024-02-22 23:39:42,258: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:39:42.259267663Z [2024-02-22 23:39:42,258: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:39:42.259335671Z [2024-02-22 23:39:42,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:39:42.259503455Z [2024-02-22 23:39:42,259: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:39:42.259632796Z [2024-02-22 23:39:42,259: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:39:42.349789425Z [2024-02-22 23:39:42,349: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:39:42.839515112Z [2024-02-22 23:39:42,838: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0fad0859-64ad-4659-8f27-52f416d9e309] succeeded in 1.937607455000034s: None 2024-02-22T23:39:43.252255513Z [2024-02-22 23:39:43,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afa2d6ce-f150-4514-a1b9-b76869b1646d] received 2024-02-22T23:39:43.262033389Z [2024-02-22 23:39:43,261: INFO/ForkPoolWorker-15] [afa2d6ce-f150-4514-a1b9-b76869b1646d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-22T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:39:43.546772623Z [2024-02-22 23:39:43,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:39:44.606290713Z [2024-02-22 23:39:44,605: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:39:44.609329802Z [2024-02-22 23:39:44,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:39:44.629950168Z [2024-02-22 23:39:44,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:39:44.630949206Z [2024-02-22 23:39:44,630: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:39:44.630991773Z [2024-02-22 23:39:44,630: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:39:44.631099575Z [2024-02-22 23:39:44,630: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:39:44.631119338Z [2024-02-22 23:39:44,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:39:44.631424981Z [2024-02-22 23:39:44,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:39:44.631852075Z [2024-02-22 23:39:44,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:39:44.722558486Z [2024-02-22 23:39:44,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:39:45.290476933Z [2024-02-22 23:39:45,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afa2d6ce-f150-4514-a1b9-b76869b1646d] succeeded in 2.0341415119999056s: None 2024-02-22T23:40:01.238990785Z [2024-02-22 23:40:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adbab273-d306-46f9-992d-eb935c06ddf9] received 2024-02-22T23:40:01.245330326Z [2024-02-22 23:40:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8be1d483-0a53-4fae-8ad4-6f5636eb35c7] received 2024-02-22T23:40:01.247147506Z [2024-02-22 23:40:01,246: INFO/ForkPoolWorker-15] [adbab273-d306-46f9-992d-eb935c06ddf9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:40:01.308939161Z [2024-02-22 23:40:01,308: INFO/ForkPoolWorker-16] [8be1d483-0a53-4fae-8ad4-6f5636eb35c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:40:01.565455333Z [2024-02-22 23:40:01,561: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:40:01.632363298Z [2024-02-22 23:40:01,629: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:40:01.894865234Z [2024-02-22 23:40:01,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:02.462003688Z [2024-02-22 23:40:02,461: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8be1d483-0a53-4fae-8ad4-6f5636eb35c7] succeeded in 1.2131669899999906s: None 2024-02-22T23:40:02.990571100Z [2024-02-22 23:40:02,990: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:40:02.994382079Z [2024-02-22 23:40:02,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:03.020186349Z [2024-02-22 23:40:03,019: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:40:03.021607399Z [2024-02-22 23:40:03,021: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:40:03.021627889Z [2024-02-22 23:40:03,021: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:40:03.021785020Z [2024-02-22 23:40:03,021: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:40:03.021867911Z [2024-02-22 23:40:03,021: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:40:03.022177401Z [2024-02-22 23:40:03,022: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:40:03.022189662Z [2024-02-22 23:40:03,022: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:40:03.132501290Z [2024-02-22 23:40:03,131: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:03.873349232Z [2024-02-22 23:40:03,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[adbab273-d306-46f9-992d-eb935c06ddf9] succeeded in 2.63249565000001s: None 2024-02-22T23:40:03.917379214Z [2024-02-22 23:40:03,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9517c45-c9eb-473a-902a-cdd5041f9ce0] received 2024-02-22T23:40:03.925067337Z [2024-02-22 23:40:03,924: INFO/ForkPoolWorker-15] [f9517c45-c9eb-473a-902a-cdd5041f9ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:40:03.955638501Z [2024-02-22 23:40:03,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5746174-e15e-4cc4-82e1-6bfb45a3d1aa] received 2024-02-22T23:40:03.961907064Z [2024-02-22 23:40:03,961: INFO/ForkPoolWorker-16] [e5746174-e15e-4cc4-82e1-6bfb45a3d1aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:40:03.972749581Z [2024-02-22 23:40:03,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16c19714-352b-4a56-b75b-bcdaf215944f] received 2024-02-22T23:40:04.029333745Z [2024-02-22 23:40:04,028: INFO/ForkPoolWorker-1] [16c19714-352b-4a56-b75b-bcdaf215944f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:40:04.429566445Z [2024-02-22 23:40:04,426: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:40:04.431597663Z [2024-02-22 23:40:04,426: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:40:04.470322757Z [2024-02-22 23:40:04,466: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:40:05.631356536Z [2024-02-22 23:40:05,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90bacb80-1459-4016-92d7-390c8a84d346] received 2024-02-22T23:40:05.705826755Z [2024-02-22 23:40:05,705: INFO/ForkPoolWorker-2] [90bacb80-1459-4016-92d7-390c8a84d346] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:40:05.991723215Z [2024-02-22 23:40:05,991: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:40:05.996290057Z [2024-02-22 23:40:05,995: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:06.038228255Z [2024-02-22 23:40:06,037: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:40:06.043432757Z [2024-02-22 23:40:06,042: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:06.047082697Z [2024-02-22 23:40:06,046: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:40:06.053325301Z [2024-02-22 23:40:06,053: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:40:06.053866900Z [2024-02-22 23:40:06,053: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:40:06.054145435Z [2024-02-22 23:40:06,053: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:40:06.054285950Z [2024-02-22 23:40:06,054: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:40:06.054639743Z [2024-02-22 23:40:06,054: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:40:06.055435905Z [2024-02-22 23:40:06,054: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:40:06.084086715Z [2024-02-22 23:40:06,082: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:40:06.086567211Z [2024-02-22 23:40:06,086: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:40:06.086584566Z [2024-02-22 23:40:06,086: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:40:06.086916014Z [2024-02-22 23:40:06,086: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:40:06.086929815Z [2024-02-22 23:40:06,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:40:06.087256885Z [2024-02-22 23:40:06,087: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:40:06.087710200Z [2024-02-22 23:40:06,087: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:40:06.145048379Z [2024-02-22 23:40:06,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:06.168443846Z [2024-02-22 23:40:06,164: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:40:06.210877593Z [2024-02-22 23:40:06,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:06.480314068Z [2024-02-22 23:40:06,479: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-22T23:40:06.485661973Z [2024-02-22 23:40:06,485: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:06.486687805Z [2024-02-22 23:40:06,486: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:40:06.490607806Z [2024-02-22 23:40:06,490: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:06.515290924Z [2024-02-22 23:40:06,515: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:40:06.518411419Z [2024-02-22 23:40:06,518: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:40:06.518603043Z [2024-02-22 23:40:06,518: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:40:06.518725158Z [2024-02-22 23:40:06,518: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-22T23:40:06.519145152Z [2024-02-22 23:40:06,518: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:40:06.523791731Z [2024-02-22 23:40:06,523: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:40:06.528884642Z [2024-02-22 23:40:06,528: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:40:06.531117871Z [2024-02-22 23:40:06,528: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:40:06.531335996Z [2024-02-22 23:40:06,531: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:40:06.531401671Z [2024-02-22 23:40:06,531: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:40:06.531768110Z [2024-02-22 23:40:06,531: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:40:06.532215105Z [2024-02-22 23:40:06,532: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:40:06.636405025Z [2024-02-22 23:40:06,636: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:06.653696174Z [2024-02-22 23:40:06,653: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:07.183161057Z [2024-02-22 23:40:07,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7452c6ce-1807-40dd-8346-43f0f3cdd3ef] received 2024-02-22T23:40:07.246139133Z [2024-02-22 23:40:07,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9517c45-c9eb-473a-902a-cdd5041f9ce0] succeeded in 3.3264760170000045s: None 2024-02-22T23:40:07.272488241Z [2024-02-22 23:40:07,272: INFO/ForkPoolWorker-3] [7452c6ce-1807-40dd-8346-43f0f3cdd3ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:40:07.393400666Z [2024-02-22 23:40:07,393: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[90bacb80-1459-4016-92d7-390c8a84d346] succeeded in 1.7584291059999941s: None 2024-02-22T23:40:07.585115855Z [2024-02-22 23:40:07,581: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:40:08.482998995Z [2024-02-22 23:40:08,477: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[16c19714-352b-4a56-b75b-bcdaf215944f] succeeded in 4.497212409999975s: None 2024-02-22T23:40:08.658245189Z [2024-02-22 23:40:08,657: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5746174-e15e-4cc4-82e1-6bfb45a3d1aa] succeeded in 4.700810039000089s: None 2024-02-22T23:40:08.729052869Z [2024-02-22 23:40:08,728: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-22T23:40:08.732295855Z [2024-02-22 23:40:08,731: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:08.755565960Z [2024-02-22 23:40:08,755: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-22T23:40:08.757125091Z [2024-02-22 23:40:08,756: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:40:08.757138911Z [2024-02-22 23:40:08,756: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:40:08.757285001Z [2024-02-22 23:40:08,757: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:40:08.757292909Z [2024-02-22 23:40:08,757: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-22T23:40:08.757632280Z [2024-02-22 23:40:08,757: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:40:08.757639132Z [2024-02-22 23:40:08,757: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:40:08.873469629Z [2024-02-22 23:40:08,873: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:09.544996143Z [2024-02-22 23:40:09,544: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7452c6ce-1807-40dd-8346-43f0f3cdd3ef] succeeded in 2.3591274420000445s: None 2024-02-22T23:40:10.496557734Z [2024-02-22 23:40:10,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9999b5f-b629-4b48-b5ae-4806731692fd] received 2024-02-22T23:40:10.507401101Z [2024-02-22 23:40:10,507: INFO/ForkPoolWorker-15] [d9999b5f-b629-4b48-b5ae-4806731692fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:40:10.794988629Z [2024-02-22 23:40:10,792: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:40:12.043819682Z [2024-02-22 23:40:12,043: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:40:12.047245259Z [2024-02-22 23:40:12,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:40:12.073772141Z [2024-02-22 23:40:12,073: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:40:12.075520804Z [2024-02-22 23:40:12,075: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:40:12.075659225Z [2024-02-22 23:40:12,075: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:40:12.075874680Z [2024-02-22 23:40:12,075: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:40:12.075977878Z [2024-02-22 23:40:12,075: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:40:12.076438506Z [2024-02-22 23:40:12,076: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:40:12.076508359Z [2024-02-22 23:40:12,076: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:40:12.201513879Z [2024-02-22 23:40:12,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:40:12.871832615Z [2024-02-22 23:40:12,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9999b5f-b629-4b48-b5ae-4806731692fd] succeeded in 2.3722404619998088s: None 2024-02-22T23:41:00.308381134Z [2024-02-22 23:41:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3929c319-beab-48d0-953e-bc9cb569d5bd] received 2024-02-22T23:41:00.315357254Z [2024-02-22 23:41:00,315: INFO/ForkPoolWorker-15] [3929c319-beab-48d0-953e-bc9cb569d5bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:41:00.315704861Z [2024-02-22 23:41:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6242adf1-a622-4d8d-a44c-22a31f45f560] received 2024-02-22T23:41:00.324035986Z [2024-02-22 23:41:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f971313-0a62-4dfb-955d-96ccdba09f3d] received 2024-02-22T23:41:00.326514544Z [2024-02-22 23:41:00,326: INFO/ForkPoolWorker-16] [6242adf1-a622-4d8d-a44c-22a31f45f560] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:41:00.332582740Z [2024-02-22 23:41:00,332: INFO/ForkPoolWorker-1] [8f971313-0a62-4dfb-955d-96ccdba09f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:41:00.613304409Z [2024-02-22 23:41:00,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:41:00.649396052Z [2024-02-22 23:41:00,646: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:41:00.693415075Z [2024-02-22 23:41:00,690: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:41:00.857024715Z [2024-02-22 23:41:00,856: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:41:00.860881728Z [2024-02-22 23:41:00,860: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:00.889633498Z [2024-02-22 23:41:00,889: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:41:00.891724931Z [2024-02-22 23:41:00,891: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:41:00.891929602Z [2024-02-22 23:41:00,891: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:41:00.892061019Z [2024-02-22 23:41:00,891: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:41:00.892431243Z [2024-02-22 23:41:00,892: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:41:01.015575759Z [2024-02-22 23:41:01,015: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:01.757434456Z [2024-02-22 23:41:01,756: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f971313-0a62-4dfb-955d-96ccdba09f3d] succeeded in 1.4317192699998031s: None 2024-02-22T23:41:01.783835063Z [2024-02-22 23:41:01,783: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:41:01.787845964Z [2024-02-22 23:41:01,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:01.808593785Z [2024-02-22 23:41:01,808: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:41:01.810101644Z [2024-02-22 23:41:01,809: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:01.810235811Z [2024-02-22 23:41:01,810: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:01.810367235Z [2024-02-22 23:41:01,810: INFO/ForkPoolWorker-15] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:01.810584380Z [2024-02-22 23:41:01,810: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:01.810691395Z [2024-02-22 23:41:01,810: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:41:01.811187962Z [2024-02-22 23:41:01,810: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:41:01.811292152Z [2024-02-22 23:41:01,811: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:01.815802025Z [2024-02-22 23:41:01,815: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:01.888071633Z [2024-02-22 23:41:01,887: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:41:01.891594330Z [2024-02-22 23:41:01,891: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:01.899802393Z [2024-02-22 23:41:01,899: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:01.926156581Z [2024-02-22 23:41:01,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:41:01.928313669Z [2024-02-22 23:41:01,927: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:01.928390088Z [2024-02-22 23:41:01,928: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:01.928486019Z [2024-02-22 23:41:01,928: INFO/ForkPoolWorker-16] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:01.928768084Z [2024-02-22 23:41:01,928: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:01.928845929Z [2024-02-22 23:41:01,928: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:41:01.929242313Z [2024-02-22 23:41:01,929: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:41:01.929343837Z [2024-02-22 23:41:01,929: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:01.937526817Z [2024-02-22 23:41:01,937: INFO/ForkPoolWorker-16] Creating DAG vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:02.020835155Z [2024-02-22 23:41:02,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:03.908889607Z [2024-02-22 23:41:03,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6242adf1-a622-4d8d-a44c-22a31f45f560] succeeded in 3.5916654819998257s: None 2024-02-22T23:41:04.307880104Z [2024-02-22 23:41:04,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3929c319-beab-48d0-953e-bc9cb569d5bd] succeeded in 3.997474608999937s: None 2024-02-22T23:41:09.937916894Z [2024-02-22 23:41:09,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[961f4e69-071b-4c5e-8030-3e6904b9420c] received 2024-02-22T23:41:09.959988846Z [2024-02-22 23:41:09,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09c61b96-c54b-400d-8384-6af5945a61d6] received 2024-02-22T23:41:09.960010418Z [2024-02-22 23:41:09,947: INFO/ForkPoolWorker-15] [961f4e69-071b-4c5e-8030-3e6904b9420c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:41:09.966934083Z [2024-02-22 23:41:09,963: INFO/ForkPoolWorker-16] [09c61b96-c54b-400d-8384-6af5945a61d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:41:10.265687538Z [2024-02-22 23:41:10,262: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:41:10.296385428Z [2024-02-22 23:41:10,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:41:11.456433418Z [2024-02-22 23:41:11,456: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:41:11.460029351Z [2024-02-22 23:41:11,459: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:11.483716450Z [2024-02-22 23:41:11,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:41:11.485135575Z [2024-02-22 23:41:11,484: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:11.485338648Z [2024-02-22 23:41:11,485: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:11.485529341Z [2024-02-22 23:41:11,485: INFO/ForkPoolWorker-15] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:11.485765958Z [2024-02-22 23:41:11,485: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:11.485885522Z [2024-02-22 23:41:11,485: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:41:11.486277019Z [2024-02-22 23:41:11,486: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:41:11.486383899Z [2024-02-22 23:41:11,486: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:11.490643653Z [2024-02-22 23:41:11,490: INFO/ForkPoolWorker-15] Creating DAG vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:11.544824031Z [2024-02-22 23:41:11,544: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:41:11.548340704Z [2024-02-22 23:41:11,547: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:11.568282793Z [2024-02-22 23:41:11,568: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:41:11.569648180Z [2024-02-22 23:41:11,569: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:11.569799555Z [2024-02-22 23:41:11,569: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:11.570003710Z [2024-02-22 23:41:11,569: INFO/ForkPoolWorker-16] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:11.570194642Z [2024-02-22 23:41:11,569: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:11.570301271Z [2024-02-22 23:41:11,570: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:41:11.570594221Z [2024-02-22 23:41:11,570: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:41:11.570728378Z [2024-02-22 23:41:11,570: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:11.571113253Z [2024-02-22 23:41:11,570: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:11.576482549Z [2024-02-22 23:41:11,576: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:11.666071301Z [2024-02-22 23:41:11,665: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:12.982398056Z [2024-02-22 23:41:12,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[283d0d86-f691-4715-8c88-1f5579978714] received 2024-02-22T23:41:12.997730889Z [2024-02-22 23:41:12,997: INFO/ForkPoolWorker-1] [283d0d86-f691-4715-8c88-1f5579978714] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:41:13.045591188Z [2024-02-22 23:41:13,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[961f4e69-071b-4c5e-8030-3e6904b9420c] succeeded in 3.1062279420000323s: None 2024-02-22T23:41:13.270690478Z [2024-02-22 23:41:13,267: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:41:13.523047612Z [2024-02-22 23:41:13,522: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[09c61b96-c54b-400d-8384-6af5945a61d6] succeeded in 3.5739077840000846s: None 2024-02-22T23:41:14.340410365Z [2024-02-22 23:41:14,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:41:14.343383636Z [2024-02-22 23:41:14,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:14.365357077Z [2024-02-22 23:41:14,365: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:41:14.366961955Z [2024-02-22 23:41:14,366: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:14.366981069Z [2024-02-22 23:41:14,366: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:14.366994940Z [2024-02-22 23:41:14,366: INFO/ForkPoolWorker-1] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:14.367146938Z [2024-02-22 23:41:14,366: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:14.367187775Z [2024-02-22 23:41:14,367: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:41:14.367563563Z [2024-02-22 23:41:14,367: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:41:14.367580243Z [2024-02-22 23:41:14,367: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:14.374286518Z [2024-02-22 23:41:14,373: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:14.472296640Z [2024-02-22 23:41:14,471: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:15.167473663Z [2024-02-22 23:41:15,166: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[283d0d86-f691-4715-8c88-1f5579978714] succeeded in 2.181055959000105s: None 2024-02-22T23:41:15.767932958Z [2024-02-22 23:41:15,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a833c156-1a29-43e8-89cb-a684b4df7316] received 2024-02-22T23:41:15.779282914Z [2024-02-22 23:41:15,778: INFO/ForkPoolWorker-15] [a833c156-1a29-43e8-89cb-a684b4df7316] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'split_metrics', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:41:16.037747090Z [2024-02-22 23:41:16,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:41:17.050725847Z [2024-02-22 23:41:17,050: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:41:17.053889778Z [2024-02-22 23:41:17,053: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:17.095267294Z [2024-02-22 23:41:17,092: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:41:17.096887440Z [2024-02-22 23:41:17,096: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:17.097006951Z [2024-02-22 23:41:17,096: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:17.097116271Z [2024-02-22 23:41:17,097: INFO/ForkPoolWorker-15] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:17.097301296Z [2024-02-22 23:41:17,097: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:17.097394348Z [2024-02-22 23:41:17,097: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:41:17.098028331Z [2024-02-22 23:41:17,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:41:17.098046355Z [2024-02-22 23:41:17,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:17.103895418Z [2024-02-22 23:41:17,103: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:17.175189555Z [2024-02-22 23:41:17,174: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:17.835854430Z [2024-02-22 23:41:17,835: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a833c156-1a29-43e8-89cb-a684b4df7316] succeeded in 2.0648055319998093s: None 2024-02-22T23:41:18.153107430Z [2024-02-22 23:41:18,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31c4db42-3993-4944-a51b-38ad59da10e7] received 2024-02-22T23:41:18.167792231Z [2024-02-22 23:41:18,167: INFO/ForkPoolWorker-15] [31c4db42-3993-4944-a51b-38ad59da10e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'collect_metrics', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:41:18.437452247Z [2024-02-22 23:41:18,434: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:41:19.461010234Z [2024-02-22 23:41:19,460: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:41:19.464123119Z [2024-02-22 23:41:19,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:19.488674745Z [2024-02-22 23:41:19,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:41:19.490065833Z [2024-02-22 23:41:19,489: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:19.490088601Z [2024-02-22 23:41:19,489: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:19.490262443Z [2024-02-22 23:41:19,490: INFO/ForkPoolWorker-15] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:19.490492713Z [2024-02-22 23:41:19,490: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:19.490616342Z [2024-02-22 23:41:19,490: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:41:19.491014054Z [2024-02-22 23:41:19,490: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:41:19.491029962Z [2024-02-22 23:41:19,490: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:19.497662420Z [2024-02-22 23:41:19,497: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:19.591157081Z [2024-02-22 23:41:19,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:20.221981096Z [2024-02-22 23:41:20,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31c4db42-3993-4944-a51b-38ad59da10e7] succeeded in 2.0622200600000724s: None 2024-02-22T23:41:20.474176243Z [2024-02-22 23:41:20,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2382617-230c-4ed8-beb0-4b7a8626f27b] received 2024-02-22T23:41:20.485794120Z [2024-02-22 23:41:20,485: INFO/ForkPoolWorker-15] [a2382617-230c-4ed8-beb0-4b7a8626f27b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'send_prometheus', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:41:20.792077751Z [2024-02-22 23:41:20,788: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:41:21.831460759Z [2024-02-22 23:41:21,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:41:21.834566894Z [2024-02-22 23:41:21,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:41:21.852024372Z [2024-02-22 23:41:21,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:41:21.853174908Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:41:21.853263998Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:41:21.853344328Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] Read VIM 4e728bf7-0222-4b4c-b6f2-cec347a88397 (basic01_253673) 2024-02-22T23:41:21.853518076Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '4e728bf7-0222-4b4c-b6f2-cec347a88397', 'name': 'basic01_253673', 'vim_type': 'openstack'}] 2024-02-22T23:41:21.853589209Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:41:21.853847421Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:41:21.853985127Z [2024-02-22 23:41:21,853: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:41:21.859542867Z [2024-02-22 23:41:21,859: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397 2024-02-22T23:41:21.925025992Z [2024-02-22 23:41:21,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:41:22.459566916Z [2024-02-22 23:41:22,459: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2382617-230c-4ed8-beb0-4b7a8626f27b] succeeded in 1.9874104279999756s: None 2024-02-22T23:42:00.415629523Z [2024-02-22 23:42:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bdf0307-20ae-42d0-ba7c-a4c6371424b4] received 2024-02-22T23:42:00.417432210Z [2024-02-22 23:42:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0ec9273-7dba-4b36-9e78-fff961ac78ad] received 2024-02-22T23:42:00.418913771Z [2024-02-22 23:42:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae3f352e-24eb-49d5-827e-c2f834862743] received 2024-02-22T23:42:00.420666224Z [2024-02-22 23:42:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c07ebbc-de0e-467f-afa2-5c303753b3c1] received 2024-02-22T23:42:00.425972122Z [2024-02-22 23:42:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6759474e-8a15-4c7e-92ba-c946a4eca60e] received 2024-02-22T23:42:00.427171575Z [2024-02-22 23:42:00,426: INFO/ForkPoolWorker-1] [ae3f352e-24eb-49d5-827e-c2f834862743] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:42:00.429787553Z [2024-02-22 23:42:00,429: INFO/ForkPoolWorker-16] [d0ec9273-7dba-4b36-9e78-fff961ac78ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:42:00.430519477Z [2024-02-22 23:42:00,430: INFO/ForkPoolWorker-2] [6c07ebbc-de0e-467f-afa2-5c303753b3c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:42:00.431120119Z [2024-02-22 23:42:00,430: INFO/ForkPoolWorker-15] [3bdf0307-20ae-42d0-ba7c-a4c6371424b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:42:00.432314160Z [2024-02-22 23:42:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f418abfd-b647-4f91-a6a5-b4eb94ef0005] received 2024-02-22T23:42:00.432970756Z [2024-02-22 23:42:00,432: INFO/ForkPoolWorker-3] [6759474e-8a15-4c7e-92ba-c946a4eca60e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:42:00.501504537Z [2024-02-22 23:42:00,500: INFO/ForkPoolWorker-4] [f418abfd-b647-4f91-a6a5-b4eb94ef0005] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:42:00.756350550Z [2024-02-22 23:42:00,752: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:00.822909672Z [2024-02-22 23:42:00,819: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:00.854785186Z [2024-02-22 23:42:00,850: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:01.061917523Z [2024-02-22 23:42:01,058: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:42:01.275673264Z [2024-02-22 23:42:01,275: INFO/ForkPoolWorker-4] Getting SDNC list 2024-02-22T23:42:01.281285445Z [2024-02-22 23:42:01,280: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:01.292061561Z [2024-02-22 23:42:01,288: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:01.326376122Z [2024-02-22 23:42:01,326: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-22T23:42:01.328040097Z [2024-02-22 23:42:01,327: INFO/ForkPoolWorker-4] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:42:01.328170854Z [2024-02-22 23:42:01,327: INFO/ForkPoolWorker-4] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:42:01.328329211Z [2024-02-22 23:42:01,328: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-02-22T23:42:01.328603000Z [2024-02-22 23:42:01,328: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:42:01.349188988Z [2024-02-22 23:42:01,342: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:42:01.521510208Z [2024-02-22 23:42:01,521: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:01.985961499Z [2024-02-22 23:42:01,985: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:02.510895080Z [2024-02-22 23:42:02,510: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[f418abfd-b647-4f91-a6a5-b4eb94ef0005] succeeded in 2.06342788500001s: None 2024-02-22T23:42:02.740830179Z [2024-02-22 23:42:02,740: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:42:02.750669294Z [2024-02-22 23:42:02,750: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:02.752582363Z [2024-02-22 23:42:02,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3bdf0307-20ae-42d0-ba7c-a4c6371424b4] succeeded in 2.3355352490000314s: None 2024-02-22T23:42:02.802113075Z [2024-02-22 23:42:02,801: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:42:02.804007653Z [2024-02-22 23:42:02,803: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:02.804049125Z [2024-02-22 23:42:02,803: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:02.804158975Z [2024-02-22 23:42:02,803: INFO/ForkPoolWorker-16] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:02.804333181Z [2024-02-22 23:42:02,804: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:02.804352192Z [2024-02-22 23:42:02,804: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:42:02.804488573Z [2024-02-22 23:42:02,804: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:42:02.804505563Z [2024-02-22 23:42:02,804: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:02.809912958Z [2024-02-22 23:42:02,809: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:02.814208252Z [2024-02-22 23:42:02,813: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:02.819327566Z [2024-02-22 23:42:02,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:02.820119564Z [2024-02-22 23:42:02,819: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:42:02.823087274Z [2024-02-22 23:42:02,822: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:02.842158106Z [2024-02-22 23:42:02,841: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-22T23:42:02.860517543Z [2024-02-22 23:42:02,860: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:42:02.862108065Z [2024-02-22 23:42:02,861: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:02.862130576Z [2024-02-22 23:42:02,862: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:02.862154085Z [2024-02-22 23:42:02,862: INFO/ForkPoolWorker-16] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:02.862296059Z [2024-02-22 23:42:02,862: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:02.862323977Z [2024-02-22 23:42:02,862: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:42:02.863194280Z [2024-02-22 23:42:02,862: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:42:02.863240888Z [2024-02-22 23:42:02,863: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:02.866263225Z [2024-02-22 23:42:02,865: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:02.870978372Z [2024-02-22 23:42:02,870: ERROR/ForkPoolWorker-16] [d0ec9273-7dba-4b36-9e78-fff961ac78ad] Failed to execute task Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:42:02.871011850Z Traceback (most recent call last): 2024-02-22T23:42:02.871036507Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:42:02.871042478Z args.func(args) 2024-02-22T23:42:02.871048012Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:42:02.871054019Z return func(*args, **kwargs) 2024-02-22T23:42:02.871058453Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:42:02.871063057Z return f(*args, **kwargs) 2024-02-22T23:42:02.871068558Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:42:02.871073326Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:42:02.871077868Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:42:02.871082595Z raise AirflowException( 2024-02-22T23:42:02.871088456Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:42:02.876770417Z [2024-02-22 23:42:02,873: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:02.899530630Z [2024-02-22 23:42:02,899: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:42:02.903194208Z [2024-02-22 23:42:02,902: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:02.920739758Z [2024-02-22 23:42:02,920: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:42:02.924387966Z [2024-02-22 23:42:02,923: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:02.936228876Z [2024-02-22 23:42:02,935: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0ec9273-7dba-4b36-9e78-fff961ac78ad] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d0ec9273-7dba-4b36-9e78-fff961ac78ad') 2024-02-22T23:42:02.936248687Z Traceback (most recent call last): 2024-02-22T23:42:02.936254833Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:42:02.936260007Z R = retval = fun(*args, **kwargs) 2024-02-22T23:42:02.936264831Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:42:02.936269570Z return self.run(*args, **kwargs) 2024-02-22T23:42:02.936294459Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:42:02.936299806Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:42:02.936304441Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:42:02.936314286Z raise AirflowException(msg) 2024-02-22T23:42:02.936320241Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d0ec9273-7dba-4b36-9e78-fff961ac78ad 2024-02-22T23:42:02.942942167Z [2024-02-22 23:42:02,942: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-22T23:42:02.945904250Z [2024-02-22 23:42:02,945: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:02.946435219Z [2024-02-22 23:42:02,946: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:02.946669675Z [2024-02-22 23:42:02,946: INFO/ForkPoolWorker-3] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:02.946949794Z [2024-02-22 23:42:02,946: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:02.947058230Z [2024-02-22 23:42:02,946: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-22T23:42:02.947536160Z [2024-02-22 23:42:02,947: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:42:02.947904469Z [2024-02-22 23:42:02,947: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:02.948098477Z [2024-02-22 23:42:02,947: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:42:02.949924036Z [2024-02-22 23:42:02,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:42:02.949939822Z [2024-02-22 23:42:02,949: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:02.950014414Z [2024-02-22 23:42:02,949: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:02.950024086Z [2024-02-22 23:42:02,949: INFO/ForkPoolWorker-2] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:02.950177740Z [2024-02-22 23:42:02,950: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:02.950188165Z [2024-02-22 23:42:02,950: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:42:02.950449608Z [2024-02-22 23:42:02,950: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:42:02.950525225Z [2024-02-22 23:42:02,950: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:02.953662595Z [2024-02-22 23:42:02,953: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:02.956032659Z [2024-02-22 23:42:02,955: INFO/ForkPoolWorker-2] Creating DAG vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:02.956217234Z [2024-02-22 23:42:02,956: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:02.956351515Z [2024-02-22 23:42:02,956: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:02.956453682Z [2024-02-22 23:42:02,956: INFO/ForkPoolWorker-1] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:02.956644893Z [2024-02-22 23:42:02,956: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:02.956726461Z [2024-02-22 23:42:02,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:42:02.957082517Z [2024-02-22 23:42:02,956: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:42:02.957206843Z [2024-02-22 23:42:02,957: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:02.963552174Z [2024-02-22 23:42:02,962: INFO/ForkPoolWorker-1] Creating DAG vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:02.970363765Z [2024-02-22 23:42:02,970: WARNING/ForkPoolWorker-1] Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:02.972820998Z [2024-02-22 23:42:02,970: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:02.973802350Z [2024-02-22 23:42:02,973: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:42:02.977997540Z [2024-02-22 23:42:02,977: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:03.004612778Z [2024-02-22 23:42:03,004: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:42:03.006097147Z [2024-02-22 23:42:03,005: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:03.006199664Z [2024-02-22 23:42:03,006: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:03.006296939Z [2024-02-22 23:42:03,006: INFO/ForkPoolWorker-1] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:03.006449451Z [2024-02-22 23:42:03,006: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:03.006524469Z [2024-02-22 23:42:03,006: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:42:03.006817336Z [2024-02-22 23:42:03,006: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:42:03.006943580Z [2024-02-22 23:42:03,006: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:03.009220695Z [2024-02-22 23:42:03,009: INFO/ForkPoolWorker-1] Creating DAG vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:03.013252725Z [2024-02-22 23:42:03,012: ERROR/ForkPoolWorker-1] [ae3f352e-24eb-49d5-827e-c2f834862743] Failed to execute task Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:42:03.013268652Z Traceback (most recent call last): 2024-02-22T23:42:03.013272895Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:42:03.013276812Z args.func(args) 2024-02-22T23:42:03.013280821Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:42:03.013284798Z return func(*args, **kwargs) 2024-02-22T23:42:03.013288083Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:42:03.013291462Z return f(*args, **kwargs) 2024-02-22T23:42:03.013327060Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:42:03.013330789Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:42:03.013334143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:42:03.013337328Z raise AirflowException( 2024-02-22T23:42:03.013341496Z airflow.exceptions.AirflowException: Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:42:03.050428932Z [2024-02-22 23:42:03,049: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae3f352e-24eb-49d5-827e-c2f834862743] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ae3f352e-24eb-49d5-827e-c2f834862743') 2024-02-22T23:42:03.050466013Z Traceback (most recent call last): 2024-02-22T23:42:03.050473947Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:42:03.050478584Z R = retval = fun(*args, **kwargs) 2024-02-22T23:42:03.050483687Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:42:03.050490278Z return self.run(*args, **kwargs) 2024-02-22T23:42:03.050498876Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:42:03.050506948Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:42:03.050514306Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:42:03.050522232Z raise AirflowException(msg) 2024-02-22T23:42:03.050530103Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ae3f352e-24eb-49d5-827e-c2f834862743 2024-02-22T23:42:03.067065138Z [2024-02-22 23:42:03,066: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:03.094467219Z [2024-02-22 23:42:03,094: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:04.984459568Z [2024-02-22 23:42:04,983: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6c07ebbc-de0e-467f-afa2-5c303753b3c1] succeeded in 4.561216861000048s: None 2024-02-22T23:42:05.279275194Z [2024-02-22 23:42:05,278: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6759474e-8a15-4c7e-92ba-c946a4eca60e] succeeded in 4.851940280999997s: None 2024-02-22T23:42:13.138089909Z [2024-02-22 23:42:13,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb64f72d-8f95-41bb-b9b4-3b983c6a29df] received 2024-02-22T23:42:13.146409910Z [2024-02-22 23:42:13,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17b5d329-fecf-4b04-bee4-44f0b7adf5dd] received 2024-02-22T23:42:13.155284279Z [2024-02-22 23:42:13,155: INFO/ForkPoolWorker-15] [bb64f72d-8f95-41bb-b9b4-3b983c6a29df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:42:13.157215468Z [2024-02-22 23:42:13,157: INFO/ForkPoolWorker-16] [17b5d329-fecf-4b04-bee4-44f0b7adf5dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:42:13.458845640Z [2024-02-22 23:42:13,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:13.463486204Z [2024-02-22 23:42:13,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23912c3c-aeeb-4a26-8dc8-effa98f82785] received 2024-02-22T23:42:13.475691916Z [2024-02-22 23:42:13,475: INFO/ForkPoolWorker-1] [23912c3c-aeeb-4a26-8dc8-effa98f82785] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:42:13.498015986Z [2024-02-22 23:42:13,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:13.981078273Z [2024-02-22 23:42:13,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:14.774101453Z [2024-02-22 23:42:14,773: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:42:14.780761075Z [2024-02-22 23:42:14,780: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:14.820347898Z [2024-02-22 23:42:14,820: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:42:14.821468124Z [2024-02-22 23:42:14,821: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:14.821640109Z [2024-02-22 23:42:14,821: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:14.821753739Z [2024-02-22 23:42:14,821: INFO/ForkPoolWorker-16] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:14.821927623Z [2024-02-22 23:42:14,821: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:14.822014141Z [2024-02-22 23:42:14,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:42:14.822352781Z [2024-02-22 23:42:14,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:42:14.822508347Z [2024-02-22 23:42:14,822: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:14.829875092Z [2024-02-22 23:42:14,829: INFO/ForkPoolWorker-16] Creating DAG vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:14.971575172Z [2024-02-22 23:42:14,971: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:14.973826995Z [2024-02-22 23:42:14,973: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:14.980367180Z [2024-02-22 23:42:14,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:15.003971079Z [2024-02-22 23:42:15,003: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:15.005774152Z [2024-02-22 23:42:15,005: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:15.005786934Z [2024-02-22 23:42:15,005: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:15.005841132Z [2024-02-22 23:42:15,005: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:15.005974790Z [2024-02-22 23:42:15,005: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:15.006132361Z [2024-02-22 23:42:15,005: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:15.008220293Z [2024-02-22 23:42:15,008: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:42:15.008233618Z [2024-02-22 23:42:15,008: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:15.012748867Z [2024-02-22 23:42:15,012: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:15.016799416Z [2024-02-22 23:42:15,016: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:15.017612501Z [2024-02-22 23:42:15,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:42:15.018340525Z [2024-02-22 23:42:15,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:15.021043703Z [2024-02-22 23:42:15,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:15.039465380Z [2024-02-22 23:42:15,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:15.040519784Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:15.040534597Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:15.040571090Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:15.040689596Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:15.040714193Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:15.040908400Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:42:15.040942367Z [2024-02-22 23:42:15,040: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:15.043553662Z [2024-02-22 23:42:15,043: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:15.046854252Z [2024-02-22 23:42:15,046: ERROR/ForkPoolWorker-15] [bb64f72d-8f95-41bb-b9b4-3b983c6a29df] Failed to execute task Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:42:15.046866330Z Traceback (most recent call last): 2024-02-22T23:42:15.046870762Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:42:15.046874451Z args.func(args) 2024-02-22T23:42:15.046878132Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:42:15.046881752Z return func(*args, **kwargs) 2024-02-22T23:42:15.046885143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:42:15.046892636Z return f(*args, **kwargs) 2024-02-22T23:42:15.046896169Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:42:15.046899388Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:42:15.046902529Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:42:15.046905986Z raise AirflowException( 2024-02-22T23:42:15.046909822Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:42:15.093203627Z [2024-02-22 23:42:15,092: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb64f72d-8f95-41bb-b9b4-3b983c6a29df] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bb64f72d-8f95-41bb-b9b4-3b983c6a29df') 2024-02-22T23:42:15.093219437Z Traceback (most recent call last): 2024-02-22T23:42:15.093223225Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:42:15.093226119Z R = retval = fun(*args, **kwargs) 2024-02-22T23:42:15.093229034Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:42:15.093232151Z return self.run(*args, **kwargs) 2024-02-22T23:42:15.093235580Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:42:15.093239039Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:42:15.093242001Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:42:15.093245285Z raise AirflowException(msg) 2024-02-22T23:42:15.093249119Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bb64f72d-8f95-41bb-b9b4-3b983c6a29df 2024-02-22T23:42:15.253812727Z [2024-02-22 23:42:15,253: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:42:15.261419529Z [2024-02-22 23:42:15,260: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:15.294572431Z [2024-02-22 23:42:15,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5956e94-eadb-4b38-9d47-f855d70f858e] received 2024-02-22T23:42:15.310586701Z [2024-02-22 23:42:15,310: INFO/ForkPoolWorker-15] [c5956e94-eadb-4b38-9d47-f855d70f858e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:42:15.325094033Z [2024-02-22 23:42:15,324: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:42:15.335727352Z [2024-02-22 23:42:15,335: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:15.335753445Z [2024-02-22 23:42:15,335: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:15.335785644Z [2024-02-22 23:42:15,335: INFO/ForkPoolWorker-1] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:15.335908525Z [2024-02-22 23:42:15,335: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:15.336783703Z [2024-02-22 23:42:15,335: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:42:15.336795267Z [2024-02-22 23:42:15,336: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:42:15.336798986Z [2024-02-22 23:42:15,336: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:15.362304744Z [2024-02-22 23:42:15,352: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:15.517910459Z [2024-02-22 23:42:15,517: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:15.719030159Z [2024-02-22 23:42:15,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:16.540204387Z [2024-02-22 23:42:16,539: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17b5d329-fecf-4b04-bee4-44f0b7adf5dd] succeeded in 3.389880736999885s: None 2024-02-22T23:42:16.731806025Z [2024-02-22 23:42:16,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee058918-b6da-4082-9b5a-abd221c26082] received 2024-02-22T23:42:16.754256785Z [2024-02-22 23:42:16,753: INFO/ForkPoolWorker-16] [ee058918-b6da-4082-9b5a-abd221c26082] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:42:16.784466374Z [2024-02-22 23:42:16,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:16.787725208Z [2024-02-22 23:42:16,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:16.811704324Z [2024-02-22 23:42:16,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:16.812912823Z [2024-02-22 23:42:16,812: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:16.813018431Z [2024-02-22 23:42:16,812: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:16.813131346Z [2024-02-22 23:42:16,813: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:16.813321562Z [2024-02-22 23:42:16,813: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:16.813448451Z [2024-02-22 23:42:16,813: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:16.813746759Z [2024-02-22 23:42:16,813: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:42:16.813895057Z [2024-02-22 23:42:16,813: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:16.821317093Z [2024-02-22 23:42:16,821: INFO/ForkPoolWorker-15] Creating DAG vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:16.825532750Z [2024-02-22 23:42:16,825: WARNING/ForkPoolWorker-15] Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:16.826295122Z [2024-02-22 23:42:16,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:42:16.827201598Z [2024-02-22 23:42:16,827: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:16.829690207Z [2024-02-22 23:42:16,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:16.851760831Z [2024-02-22 23:42:16,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:16.853379245Z [2024-02-22 23:42:16,853: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:16.853586797Z [2024-02-22 23:42:16,853: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:16.853671030Z [2024-02-22 23:42:16,853: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:16.853890420Z [2024-02-22 23:42:16,853: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:16.854150402Z [2024-02-22 23:42:16,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:16.854544291Z [2024-02-22 23:42:16,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:42:16.855080570Z [2024-02-22 23:42:16,854: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:16.857484121Z [2024-02-22 23:42:16,857: INFO/ForkPoolWorker-15] Creating DAG vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:16.861349098Z [2024-02-22 23:42:16,860: ERROR/ForkPoolWorker-15] [c5956e94-eadb-4b38-9d47-f855d70f858e] Failed to execute task Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:42:16.861362068Z Traceback (most recent call last): 2024-02-22T23:42:16.861366367Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:42:16.861383961Z args.func(args) 2024-02-22T23:42:16.861387420Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:42:16.861391650Z return func(*args, **kwargs) 2024-02-22T23:42:16.861395090Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:42:16.861398296Z return f(*args, **kwargs) 2024-02-22T23:42:16.861401646Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:42:16.861404765Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:42:16.861408090Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:42:16.861411324Z raise AirflowException( 2024-02-22T23:42:16.861415455Z airflow.exceptions.AirflowException: Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:42:16.899235782Z [2024-02-22 23:42:16,898: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5956e94-eadb-4b38-9d47-f855d70f858e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c5956e94-eadb-4b38-9d47-f855d70f858e') 2024-02-22T23:42:16.899256903Z Traceback (most recent call last): 2024-02-22T23:42:16.899261340Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:42:16.899264888Z R = retval = fun(*args, **kwargs) 2024-02-22T23:42:16.899268671Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:42:16.899271930Z return self.run(*args, **kwargs) 2024-02-22T23:42:16.899275951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:42:16.899279561Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:42:16.899282457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:42:16.899285953Z raise AirflowException(msg) 2024-02-22T23:42:16.899289918Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c5956e94-eadb-4b38-9d47-f855d70f858e 2024-02-22T23:42:17.100316411Z [2024-02-22 23:42:17,096: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:42:17.376389612Z [2024-02-22 23:42:17,375: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23912c3c-aeeb-4a26-8dc8-effa98f82785] succeeded in 3.9098213889999442s: None 2024-02-22T23:42:18.237187837Z [2024-02-22 23:42:18,236: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:42:18.240389928Z [2024-02-22 23:42:18,239: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:18.263811622Z [2024-02-22 23:42:18,263: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:42:18.266016961Z [2024-02-22 23:42:18,265: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:18.266351225Z [2024-02-22 23:42:18,266: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:18.266794327Z [2024-02-22 23:42:18,266: INFO/ForkPoolWorker-16] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:18.267150244Z [2024-02-22 23:42:18,266: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:18.267328370Z [2024-02-22 23:42:18,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:42:18.267706518Z [2024-02-22 23:42:18,267: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:42:18.268248761Z [2024-02-22 23:42:18,267: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:18.274517772Z [2024-02-22 23:42:18,274: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:18.357585676Z [2024-02-22 23:42:18,357: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:18.996786981Z [2024-02-22 23:42:18,996: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee058918-b6da-4082-9b5a-abd221c26082] succeeded in 2.262998965999941s: None 2024-02-22T23:42:19.213956342Z [2024-02-22 23:42:19,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5874c243-f397-4bb9-bea4-6db9244e8739] received 2024-02-22T23:42:19.224394741Z [2024-02-22 23:42:19,223: INFO/ForkPoolWorker-15] [5874c243-f397-4bb9-bea4-6db9244e8739] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'split_metrics', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:42:19.482356180Z [2024-02-22 23:42:19,479: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:42:20.587324226Z [2024-02-22 23:42:20,586: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:20.590440586Z [2024-02-22 23:42:20,589: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:20.612112251Z [2024-02-22 23:42:20,611: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:20.613419690Z [2024-02-22 23:42:20,613: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:20.613451991Z [2024-02-22 23:42:20,613: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:20.613610768Z [2024-02-22 23:42:20,613: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:20.613743877Z [2024-02-22 23:42:20,613: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:20.613774146Z [2024-02-22 23:42:20,613: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:20.614167450Z [2024-02-22 23:42:20,613: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:42:20.614203375Z [2024-02-22 23:42:20,614: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:20.620697139Z [2024-02-22 23:42:20,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:20.715565112Z [2024-02-22 23:42:20,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:21.378710987Z [2024-02-22 23:42:21,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5874c243-f397-4bb9-bea4-6db9244e8739] succeeded in 2.162323403999835s: None 2024-02-22T23:42:21.511165195Z [2024-02-22 23:42:21,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db5ffbb8-6f2e-4df2-837e-e5570f0720cf] received 2024-02-22T23:42:21.524250369Z [2024-02-22 23:42:21,523: INFO/ForkPoolWorker-15] [db5ffbb8-6f2e-4df2-837e-e5570f0720cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'collect_metrics', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:42:21.804595838Z [2024-02-22 23:42:21,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:42:22.858370081Z [2024-02-22 23:42:22,857: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:22.861535354Z [2024-02-22 23:42:22,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:22.889332838Z [2024-02-22 23:42:22,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:22.891119259Z [2024-02-22 23:42:22,890: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:22.891170529Z [2024-02-22 23:42:22,890: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:22.891193747Z [2024-02-22 23:42:22,891: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:22.891408037Z [2024-02-22 23:42:22,891: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:22.891473567Z [2024-02-22 23:42:22,891: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:22.891820057Z [2024-02-22 23:42:22,891: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:42:22.891880434Z [2024-02-22 23:42:22,891: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:22.900701707Z [2024-02-22 23:42:22,900: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:23.001102687Z [2024-02-22 23:42:23,000: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:23.633629086Z [2024-02-22 23:42:23,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db5ffbb8-6f2e-4df2-837e-e5570f0720cf] succeeded in 2.1201231489999373s: None 2024-02-22T23:42:24.236914299Z [2024-02-22 23:42:24,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[741ea045-cd38-42e5-864e-3bf717f27e44] received 2024-02-22T23:42:24.252039787Z [2024-02-22 23:42:24,251: INFO/ForkPoolWorker-15] [741ea045-cd38-42e5-864e-3bf717f27e44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'send_prometheus', 'scheduled__2024-02-22T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:42:24.524290576Z [2024-02-22 23:42:24,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:42:25.620279852Z [2024-02-22 23:42:25,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:42:25.623828957Z [2024-02-22 23:42:25,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:42:25.648681620Z [2024-02-22 23:42:25,648: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:42:25.650979179Z [2024-02-22 23:42:25,650: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:42:25.651248611Z [2024-02-22 23:42:25,651: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:42:25.651306682Z [2024-02-22 23:42:25,651: INFO/ForkPoolWorker-15] Read VIM aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 (basic01_439853) 2024-02-22T23:42:25.651563023Z [2024-02-22 23:42:25,651: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'name': 'basic01_439853', 'vim_type': 'openstack'}] 2024-02-22T23:42:25.651749206Z [2024-02-22 23:42:25,651: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:42:25.652167930Z [2024-02-22 23:42:25,651: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:42:25.652251586Z [2024-02-22 23:42:25,652: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:42:25.658928163Z [2024-02-22 23:42:25,658: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87 2024-02-22T23:42:25.752902798Z [2024-02-22 23:42:25,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:42:26.396151386Z [2024-02-22 23:42:26,395: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[741ea045-cd38-42e5-864e-3bf717f27e44] succeeded in 2.1524486209998486s: None 2024-02-22T23:43:00.795507556Z [2024-02-22 23:43:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9987294d-3eb6-4c83-ac6e-a99cf8ceeeb8] received 2024-02-22T23:43:00.799366717Z [2024-02-22 23:43:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0941a292-5490-4b0b-bc84-ba02d5e542a5] received 2024-02-22T23:43:00.805346170Z [2024-02-22 23:43:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1af50a1-4fc3-4bda-8fe0-2d240d376c4d] received 2024-02-22T23:43:00.811214777Z [2024-02-22 23:43:00,810: INFO/ForkPoolWorker-16] [0941a292-5490-4b0b-bc84-ba02d5e542a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:43:00.815584386Z [2024-02-22 23:43:00,815: INFO/ForkPoolWorker-15] [9987294d-3eb6-4c83-ac6e-a99cf8ceeeb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:43:00.822917217Z [2024-02-22 23:43:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02081419-b9e0-43ff-9e2d-369a50b73e3b] received 2024-02-22T23:43:00.826906287Z [2024-02-22 23:43:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0a0a879-7d29-4ee6-85a2-3334d90c627a] received 2024-02-22T23:43:00.833324530Z [2024-02-22 23:43:00,832: INFO/ForkPoolWorker-2] [02081419-b9e0-43ff-9e2d-369a50b73e3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:43:00.836970515Z [2024-02-22 23:43:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[821be48d-a6b5-4e9f-917f-7b598bb26529] received 2024-02-22T23:43:00.842146576Z [2024-02-22 23:43:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[064ab1f6-5614-415d-8e9e-679a87400867] received 2024-02-22T23:43:00.843874229Z [2024-02-22 23:43:00,843: INFO/ForkPoolWorker-1] [b1af50a1-4fc3-4bda-8fe0-2d240d376c4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:43:00.856780205Z [2024-02-22 23:43:00,856: INFO/ForkPoolWorker-4] [821be48d-a6b5-4e9f-917f-7b598bb26529] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:43:00.858272818Z [2024-02-22 23:43:00,857: INFO/ForkPoolWorker-3] [c0a0a879-7d29-4ee6-85a2-3334d90c627a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:43:00.904753058Z [2024-02-22 23:43:00,904: INFO/ForkPoolWorker-5] [064ab1f6-5614-415d-8e9e-679a87400867] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:43:01.340481445Z [2024-02-22 23:43:01,336: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:43:01.458818805Z [2024-02-22 23:43:01,454: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:01.478223731Z [2024-02-22 23:43:01,474: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:01.548042184Z [2024-02-22 23:43:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:01.621331037Z [2024-02-22 23:43:01,606: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:01.629021062Z [2024-02-22 23:43:01,628: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-22T23:43:01.648559290Z [2024-02-22 23:43:01,648: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:01.710699731Z [2024-02-22 23:43:01,710: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:43:01.716728263Z [2024-02-22 23:43:01,716: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:43:01.716865378Z [2024-02-22 23:43:01,716: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:43:01.716999331Z [2024-02-22 23:43:01,716: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-22T23:43:01.717313626Z [2024-02-22 23:43:01,717: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:43:01.778162159Z [2024-02-22 23:43:01,767: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:01.797912071Z [2024-02-22 23:43:01,792: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:01.993807854Z [2024-02-22 23:43:01,993: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:43:03.314884622Z [2024-02-22 23:43:03,314: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:43:03.361919081Z [2024-02-22 23:43:03,322: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:03.415253099Z [2024-02-22 23:43:03,414: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[02081419-b9e0-43ff-9e2d-369a50b73e3b] succeeded in 2.5897050339999623s: None 2024-02-22T23:43:03.428222300Z [2024-02-22 23:43:03,428: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:43:03.429814192Z [2024-02-22 23:43:03,429: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:03.429959313Z [2024-02-22 23:43:03,429: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:03.431533140Z [2024-02-22 23:43:03,431: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:03.431682336Z [2024-02-22 23:43:03,431: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:43:03.432330114Z [2024-02-22 23:43:03,432: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:03.432536307Z [2024-02-22 23:43:03,432: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:03.439577369Z [2024-02-22 23:43:03,439: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:03.440732065Z [2024-02-22 23:43:03,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:03.444300944Z [2024-02-22 23:43:03,444: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:43:03.455347428Z [2024-02-22 23:43:03,454: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:03.507890173Z [2024-02-22 23:43:03,507: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:43:03.523826440Z [2024-02-22 23:43:03,523: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:03.523935258Z [2024-02-22 23:43:03,523: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:03.524136300Z [2024-02-22 23:43:03,523: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:03.524314243Z [2024-02-22 23:43:03,524: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:43:03.524657157Z [2024-02-22 23:43:03,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:03.524675388Z [2024-02-22 23:43:03,524: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:03.528168540Z [2024-02-22 23:43:03,527: ERROR/ForkPoolWorker-15] [9987294d-3eb6-4c83-ac6e-a99cf8ceeeb8] Failed to execute task Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:03.528189011Z Traceback (most recent call last): 2024-02-22T23:43:03.528211259Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:03.528220296Z args.func(args) 2024-02-22T23:43:03.528224255Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:03.528227750Z return func(*args, **kwargs) 2024-02-22T23:43:03.528230867Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:03.528234065Z return f(*args, **kwargs) 2024-02-22T23:43:03.528237290Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:03.528240540Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:03.528243684Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:03.528247101Z raise AirflowException( 2024-02-22T23:43:03.528251061Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:03.579693171Z [2024-02-22 23:43:03,579: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9987294d-3eb6-4c83-ac6e-a99cf8ceeeb8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9987294d-3eb6-4c83-ac6e-a99cf8ceeeb8') 2024-02-22T23:43:03.579719418Z Traceback (most recent call last): 2024-02-22T23:43:03.579723699Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:03.579727287Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:03.579730476Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:03.579747639Z return self.run(*args, **kwargs) 2024-02-22T23:43:03.579751830Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:03.579755949Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:03.579763129Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:03.579766841Z raise AirflowException(msg) 2024-02-22T23:43:03.579771015Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9987294d-3eb6-4c83-ac6e-a99cf8ceeeb8 2024-02-22T23:43:03.726689565Z [2024-02-22 23:43:03,726: INFO/ForkPoolWorker-5] Getting VIM list 2024-02-22T23:43:03.733671827Z [2024-02-22 23:43:03,733: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:03.808243180Z [2024-02-22 23:43:03,807: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-02-22T23:43:03.809668594Z [2024-02-22 23:43:03,809: INFO/ForkPoolWorker-5] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:03.809797760Z [2024-02-22 23:43:03,809: INFO/ForkPoolWorker-5] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:03.809967667Z [2024-02-22 23:43:03,809: INFO/ForkPoolWorker-5] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:03.810040486Z [2024-02-22 23:43:03,809: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-02-22T23:43:03.810307213Z [2024-02-22 23:43:03,810: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:03.810720621Z [2024-02-22 23:43:03,810: INFO/ForkPoolWorker-5] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:03.818214924Z [2024-02-22 23:43:03,817: WARNING/ForkPoolWorker-5] Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:03.824734231Z [2024-02-22 23:43:03,824: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:03.825643585Z [2024-02-22 23:43:03,825: INFO/ForkPoolWorker-5] Getting VIM list 2024-02-22T23:43:03.829714489Z [2024-02-22 23:43:03,829: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:03.905913065Z [2024-02-22 23:43:03,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:43:03.909370190Z [2024-02-22 23:43:03,908: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:03.912879509Z [2024-02-22 23:43:03,912: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-02-22T23:43:03.924274847Z [2024-02-22 23:43:03,923: INFO/ForkPoolWorker-5] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:03.927188893Z [2024-02-22 23:43:03,926: INFO/ForkPoolWorker-5] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:03.927329569Z [2024-02-22 23:43:03,927: INFO/ForkPoolWorker-5] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:03.927396795Z [2024-02-22 23:43:03,927: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-02-22T23:43:03.927749440Z [2024-02-22 23:43:03,927: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:03.931884868Z [2024-02-22 23:43:03,931: INFO/ForkPoolWorker-5] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:03.947626305Z [2024-02-22 23:43:03,946: ERROR/ForkPoolWorker-5] [064ab1f6-5614-415d-8e9e-679a87400867] Failed to execute task Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:03.947647600Z Traceback (most recent call last): 2024-02-22T23:43:03.947651831Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:03.947655954Z args.func(args) 2024-02-22T23:43:03.947659908Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:03.947676731Z return func(*args, **kwargs) 2024-02-22T23:43:03.947680248Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:03.947683530Z return f(*args, **kwargs) 2024-02-22T23:43:03.947686718Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:03.947689943Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:03.947693163Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:03.947696379Z raise AirflowException( 2024-02-22T23:43:03.947700056Z airflow.exceptions.AirflowException: Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:04.051878217Z [2024-02-22 23:43:04,051: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[064ab1f6-5614-415d-8e9e-679a87400867] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 064ab1f6-5614-415d-8e9e-679a87400867') 2024-02-22T23:43:04.051903522Z Traceback (most recent call last): 2024-02-22T23:43:04.051909743Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:04.051915055Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:04.051919990Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:04.051925235Z return self.run(*args, **kwargs) 2024-02-22T23:43:04.051931385Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:04.051938123Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:04.051942972Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:04.051949068Z raise AirflowException(msg) 2024-02-22T23:43:04.051955085Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 064ab1f6-5614-415d-8e9e-679a87400867 2024-02-22T23:43:04.205720067Z [2024-02-22 23:43:04,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:43:04.214807500Z [2024-02-22 23:43:04,214: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:04.214896869Z [2024-02-22 23:43:04,214: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:04.214993359Z [2024-02-22 23:43:04,214: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:04.215052929Z [2024-02-22 23:43:04,214: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:43:04.215917748Z [2024-02-22 23:43:04,215: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:04.217409413Z [2024-02-22 23:43:04,217: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:04.235508304Z [2024-02-22 23:43:04,235: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:04.237895423Z [2024-02-22 23:43:04,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:04.238906328Z [2024-02-22 23:43:04,238: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:43:04.244757804Z [2024-02-22 23:43:04,244: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:04.284633318Z [2024-02-22 23:43:04,284: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:43:04.286454035Z [2024-02-22 23:43:04,286: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:04.286633981Z [2024-02-22 23:43:04,286: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:04.286803405Z [2024-02-22 23:43:04,286: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:04.286959608Z [2024-02-22 23:43:04,286: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:43:04.287715989Z [2024-02-22 23:43:04,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:04.288254897Z [2024-02-22 23:43:04,287: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:04.293321764Z [2024-02-22 23:43:04,292: ERROR/ForkPoolWorker-16] [0941a292-5490-4b0b-bc84-ba02d5e542a5] Failed to execute task Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:04.293356930Z Traceback (most recent call last): 2024-02-22T23:43:04.293362112Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:04.293366700Z args.func(args) 2024-02-22T23:43:04.293370438Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:04.293387124Z return func(*args, **kwargs) 2024-02-22T23:43:04.293390170Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:04.293393411Z return f(*args, **kwargs) 2024-02-22T23:43:04.293396502Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:04.293399529Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:04.293402940Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:04.293405924Z raise AirflowException( 2024-02-22T23:43:04.293409773Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:04.327862671Z [2024-02-22 23:43:04,327: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0941a292-5490-4b0b-bc84-ba02d5e542a5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0941a292-5490-4b0b-bc84-ba02d5e542a5') 2024-02-22T23:43:04.327882189Z Traceback (most recent call last): 2024-02-22T23:43:04.327886609Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:04.327891006Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:04.327894366Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:04.327897569Z return self.run(*args, **kwargs) 2024-02-22T23:43:04.327901599Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:04.327905871Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:04.327909084Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:04.327913020Z raise AirflowException(msg) 2024-02-22T23:43:04.327917082Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0941a292-5490-4b0b-bc84-ba02d5e542a5 2024-02-22T23:43:04.432675782Z [2024-02-22 23:43:04,432: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-22T23:43:04.435934573Z [2024-02-22 23:43:04,435: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:04.459731137Z [2024-02-22 23:43:04,459: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-22T23:43:04.461091772Z [2024-02-22 23:43:04,460: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:04.461625346Z [2024-02-22 23:43:04,460: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:04.461840302Z [2024-02-22 23:43:04,461: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:04.461919271Z [2024-02-22 23:43:04,461: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-22T23:43:04.462465180Z [2024-02-22 23:43:04,462: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:04.462656605Z [2024-02-22 23:43:04,462: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:04.469173784Z [2024-02-22 23:43:04,468: WARNING/ForkPoolWorker-4] Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:04.469946257Z [2024-02-22 23:43:04,469: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:04.470816737Z [2024-02-22 23:43:04,470: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-22T23:43:04.473446949Z [2024-02-22 23:43:04,473: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:04.485331362Z [2024-02-22 23:43:04,485: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-22T23:43:04.486540364Z [2024-02-22 23:43:04,486: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:04.486748089Z [2024-02-22 23:43:04,486: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:04.486947213Z [2024-02-22 23:43:04,486: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:04.487016134Z [2024-02-22 23:43:04,486: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-22T23:43:04.487295363Z [2024-02-22 23:43:04,487: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:04.487303895Z [2024-02-22 23:43:04,487: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:04.490616975Z [2024-02-22 23:43:04,490: ERROR/ForkPoolWorker-4] [821be48d-a6b5-4e9f-917f-7b598bb26529] Failed to execute task Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:04.490632601Z Traceback (most recent call last): 2024-02-22T23:43:04.490636802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:04.490640985Z args.func(args) 2024-02-22T23:43:04.490644834Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:04.490649204Z return func(*args, **kwargs) 2024-02-22T23:43:04.490652420Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:04.490655642Z return f(*args, **kwargs) 2024-02-22T23:43:04.490673061Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:04.490676774Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:04.490679959Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:04.490683123Z raise AirflowException( 2024-02-22T23:43:04.490686887Z airflow.exceptions.AirflowException: Dag 'vim_status_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:04.521855764Z [2024-02-22 23:43:04,521: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[821be48d-a6b5-4e9f-917f-7b598bb26529] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 821be48d-a6b5-4e9f-917f-7b598bb26529') 2024-02-22T23:43:04.521908527Z Traceback (most recent call last): 2024-02-22T23:43:04.521913232Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:04.521916475Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:04.521919604Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:04.521922831Z return self.run(*args, **kwargs) 2024-02-22T23:43:04.521927008Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:04.521930833Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:04.521933983Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:04.521937556Z raise AirflowException(msg) 2024-02-22T23:43:04.521941617Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 821be48d-a6b5-4e9f-917f-7b598bb26529 2024-02-22T23:43:04.656328272Z [2024-02-22 23:43:04,655: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:43:04.659885349Z [2024-02-22 23:43:04,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:04.675514112Z [2024-02-22 23:43:04,675: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-22T23:43:04.681482838Z [2024-02-22 23:43:04,681: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:43:04.682040881Z [2024-02-22 23:43:04,681: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:04.683606109Z [2024-02-22 23:43:04,683: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:04.683838569Z [2024-02-22 23:43:04,683: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:04.684154873Z [2024-02-22 23:43:04,683: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:04.684398427Z [2024-02-22 23:43:04,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:43:04.687177859Z [2024-02-22 23:43:04,686: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:04.687270917Z [2024-02-22 23:43:04,687: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:04.716521407Z [2024-02-22 23:43:04,716: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-22T23:43:04.740299607Z [2024-02-22 23:43:04,733: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:04.740322179Z [2024-02-22 23:43:04,733: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:04.740326482Z [2024-02-22 23:43:04,733: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:04.740330788Z [2024-02-22 23:43:04,733: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-22T23:43:04.740346423Z [2024-02-22 23:43:04,733: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:04.740349699Z [2024-02-22 23:43:04,733: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:04.812788927Z [2024-02-22 23:43:04,812: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:43:04.837824515Z [2024-02-22 23:43:04,837: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:43:06.885975298Z [2024-02-22 23:43:06,885: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c0a0a879-7d29-4ee6-85a2-3334d90c627a] succeeded in 6.056866159000037s: None 2024-02-22T23:43:07.663880343Z [2024-02-22 23:43:07,663: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1af50a1-4fc3-4bda-8fe0-2d240d376c4d] succeeded in 6.837885173999894s: None 2024-02-22T23:43:14.338097869Z [2024-02-22 23:43:14,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d825f6e6-7819-4d25-b6e3-993b50517198] received 2024-02-22T23:43:14.346277684Z [2024-02-22 23:43:14,346: INFO/ForkPoolWorker-15] [d825f6e6-7819-4d25-b6e3-993b50517198] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:43:14.352410456Z [2024-02-22 23:43:14,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[070b161f-68cb-4cdb-9f3b-ca3cde613d7f] received 2024-02-22T23:43:14.364346633Z [2024-02-22 23:43:14,364: INFO/ForkPoolWorker-16] [070b161f-68cb-4cdb-9f3b-ca3cde613d7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:43:14.665416342Z [2024-02-22 23:43:14,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:14.679119706Z [2024-02-22 23:43:14,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:15.733729320Z [2024-02-22 23:43:15,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eff97895-83ed-4565-8773-c8ae78a662d4] received 2024-02-22T23:43:15.743049993Z [2024-02-22 23:43:15,742: INFO/ForkPoolWorker-1] [eff97895-83ed-4565-8773-c8ae78a662d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:43:15.983071316Z [2024-02-22 23:43:15,982: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:43:15.986122360Z [2024-02-22 23:43:15,985: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:16.030805827Z [2024-02-22 23:43:16,030: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:43:16.034642095Z [2024-02-22 23:43:16,034: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:16.034659100Z [2024-02-22 23:43:16,034: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:16.034955260Z [2024-02-22 23:43:16,034: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:16.035021946Z [2024-02-22 23:43:16,034: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:43:16.035252129Z [2024-02-22 23:43:16,035: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:16.035306949Z [2024-02-22 23:43:16,035: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:16.041183822Z [2024-02-22 23:43:16,041: WARNING/ForkPoolWorker-16] Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:16.042003638Z [2024-02-22 23:43:16,041: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:43:16.042746724Z [2024-02-22 23:43:16,042: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:43:16.045168442Z [2024-02-22 23:43:16,044: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:16.075747840Z [2024-02-22 23:43:16,075: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:43:16.080116703Z [2024-02-22 23:43:16,079: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:16.080229267Z [2024-02-22 23:43:16,080: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:16.080535433Z [2024-02-22 23:43:16,080: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:16.080675113Z [2024-02-22 23:43:16,080: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:43:16.081018970Z [2024-02-22 23:43:16,080: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:43:16.081159982Z [2024-02-22 23:43:16,080: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:16.086363845Z [2024-02-22 23:43:16,085: ERROR/ForkPoolWorker-16] [070b161f-68cb-4cdb-9f3b-ca3cde613d7f] Failed to execute task Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:16.086377025Z Traceback (most recent call last): 2024-02-22T23:43:16.086381488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:16.086385528Z args.func(args) 2024-02-22T23:43:16.086389420Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:16.086393266Z return func(*args, **kwargs) 2024-02-22T23:43:16.086404463Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:16.086422257Z return f(*args, **kwargs) 2024-02-22T23:43:16.086425651Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:16.086428750Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:16.086431944Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:16.086440370Z raise AirflowException( 2024-02-22T23:43:16.086444400Z airflow.exceptions.AirflowException: Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:16.102392416Z [2024-02-22 23:43:16,099: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:16.119098584Z [2024-02-22 23:43:16,118: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[070b161f-68cb-4cdb-9f3b-ca3cde613d7f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 070b161f-68cb-4cdb-9f3b-ca3cde613d7f') 2024-02-22T23:43:16.119113315Z Traceback (most recent call last): 2024-02-22T23:43:16.119117196Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:16.119120254Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:16.119123358Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:16.119147274Z return self.run(*args, **kwargs) 2024-02-22T23:43:16.119150869Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:16.119154233Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:16.119156856Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:16.119159969Z raise AirflowException(msg) 2024-02-22T23:43:16.119163130Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 070b161f-68cb-4cdb-9f3b-ca3cde613d7f 2024-02-22T23:43:16.342163341Z [2024-02-22 23:43:16,341: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:43:16.345221212Z [2024-02-22 23:43:16,344: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:16.370913571Z [2024-02-22 23:43:16,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:43:16.374361105Z [2024-02-22 23:43:16,374: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:16.374779264Z [2024-02-22 23:43:16,374: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:16.374984758Z [2024-02-22 23:43:16,374: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:16.375049582Z [2024-02-22 23:43:16,374: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:43:16.375257650Z [2024-02-22 23:43:16,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:16.375303587Z [2024-02-22 23:43:16,375: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:16.382132728Z [2024-02-22 23:43:16,381: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:16.383096631Z [2024-02-22 23:43:16,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:16.383889379Z [2024-02-22 23:43:16,383: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:43:16.386413388Z [2024-02-22 23:43:16,386: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:16.423890295Z [2024-02-22 23:43:16,423: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:43:16.424864862Z [2024-02-22 23:43:16,424: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:16.424876559Z [2024-02-22 23:43:16,424: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:16.424974363Z [2024-02-22 23:43:16,424: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:16.425005763Z [2024-02-22 23:43:16,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:43:16.425206669Z [2024-02-22 23:43:16,425: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:16.425234957Z [2024-02-22 23:43:16,425: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:16.429286875Z [2024-02-22 23:43:16,428: ERROR/ForkPoolWorker-15] [d825f6e6-7819-4d25-b6e3-993b50517198] Failed to execute task Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:16.429303121Z Traceback (most recent call last): 2024-02-22T23:43:16.429306988Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:16.429326268Z args.func(args) 2024-02-22T23:43:16.429330467Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:16.429334048Z return func(*args, **kwargs) 2024-02-22T23:43:16.429336958Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:16.429339780Z return f(*args, **kwargs) 2024-02-22T23:43:16.429342778Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:16.429345942Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:16.429348836Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:16.429351667Z raise AirflowException( 2024-02-22T23:43:16.429358720Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_4e728bf7-0222-4b4c-b6f2-cec347a88397' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:16.469239419Z [2024-02-22 23:43:16,468: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d825f6e6-7819-4d25-b6e3-993b50517198] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d825f6e6-7819-4d25-b6e3-993b50517198') 2024-02-22T23:43:16.469281665Z Traceback (most recent call last): 2024-02-22T23:43:16.469286885Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:16.469290255Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:16.469293290Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:16.469296330Z return self.run(*args, **kwargs) 2024-02-22T23:43:16.469299849Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:16.469303702Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:16.469306788Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:16.469310308Z raise AirflowException(msg) 2024-02-22T23:43:16.469314583Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d825f6e6-7819-4d25-b6e3-993b50517198 2024-02-22T23:43:17.234240156Z [2024-02-22 23:43:17,233: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:43:17.237155186Z [2024-02-22 23:43:17,236: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:17.257761053Z [2024-02-22 23:43:17,257: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:43:17.259182372Z [2024-02-22 23:43:17,258: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:17.259236947Z [2024-02-22 23:43:17,259: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:17.259371002Z [2024-02-22 23:43:17,259: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:17.259489676Z [2024-02-22 23:43:17,259: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:43:17.259898254Z [2024-02-22 23:43:17,259: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:17.260020531Z [2024-02-22 23:43:17,259: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:17.266674621Z [2024-02-22 23:43:17,266: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:17.267558633Z [2024-02-22 23:43:17,266: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:43:17.268349114Z [2024-02-22 23:43:17,268: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:43:17.270788059Z [2024-02-22 23:43:17,270: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:43:17.286556386Z [2024-02-22 23:43:17,286: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:43:17.287910723Z [2024-02-22 23:43:17,287: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:43:17.288049823Z [2024-02-22 23:43:17,287: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:43:17.288134365Z [2024-02-22 23:43:17,287: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:43:17.288147327Z [2024-02-22 23:43:17,288: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:43:17.288547583Z [2024-02-22 23:43:17,288: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:43:17.288677542Z [2024-02-22 23:43:17,288: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:43:17.292118291Z [2024-02-22 23:43:17,291: ERROR/ForkPoolWorker-1] [eff97895-83ed-4565-8773-c8ae78a662d4] Failed to execute task Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:43:17.292146131Z Traceback (most recent call last): 2024-02-22T23:43:17.292156062Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:43:17.292164399Z args.func(args) 2024-02-22T23:43:17.292172426Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:43:17.292180105Z return func(*args, **kwargs) 2024-02-22T23:43:17.292187233Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:43:17.292194512Z return f(*args, **kwargs) 2024-02-22T23:43:17.292201681Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:43:17.292208841Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:43:17.292216044Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:43:17.292223144Z raise AirflowException( 2024-02-22T23:43:17.292231501Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:43:17.346188888Z [2024-02-22 23:43:17,345: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eff97895-83ed-4565-8773-c8ae78a662d4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eff97895-83ed-4565-8773-c8ae78a662d4') 2024-02-22T23:43:17.346212932Z Traceback (most recent call last): 2024-02-22T23:43:17.346219231Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:43:17.346224408Z R = retval = fun(*args, **kwargs) 2024-02-22T23:43:17.346230030Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:43:17.346235196Z return self.run(*args, **kwargs) 2024-02-22T23:43:17.346240950Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:43:17.346246659Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:43:17.346252105Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:43:17.346258101Z raise AirflowException(msg) 2024-02-22T23:43:17.346264116Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eff97895-83ed-4565-8773-c8ae78a662d4 2024-02-22T23:44:01.011532146Z [2024-02-22 23:44:01,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea84fbb7-eff6-4aa5-8fb6-3c564f1c6186] received 2024-02-22T23:44:01.015793248Z [2024-02-22 23:44:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fc5f748-ff49-4b7a-bebd-1b80b98cfbeb] received 2024-02-22T23:44:01.024699910Z [2024-02-22 23:44:01,024: INFO/ForkPoolWorker-16] [6fc5f748-ff49-4b7a-bebd-1b80b98cfbeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:44:01.024808063Z [2024-02-22 23:44:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44b50391-da02-46fb-93aa-06941d7757ab] received 2024-02-22T23:44:01.026568051Z [2024-02-22 23:44:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aa3d999-2ca2-4800-8f60-b74528707beb] received 2024-02-22T23:44:01.028323233Z [2024-02-22 23:44:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[457070db-99fe-4016-a6de-6fec0c9cca00] received 2024-02-22T23:44:01.030097376Z [2024-02-22 23:44:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccb77e57-9c58-4616-8f24-0909868c7269] received 2024-02-22T23:44:01.036172581Z [2024-02-22 23:44:01,035: INFO/ForkPoolWorker-1] [44b50391-da02-46fb-93aa-06941d7757ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:44:01.038014081Z [2024-02-22 23:44:01,037: INFO/ForkPoolWorker-15] [ea84fbb7-eff6-4aa5-8fb6-3c564f1c6186] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:44:01.040714761Z [2024-02-22 23:44:01,040: INFO/ForkPoolWorker-2] [9aa3d999-2ca2-4800-8f60-b74528707beb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:44:01.044953656Z [2024-02-22 23:44:01,044: INFO/ForkPoolWorker-4] [ccb77e57-9c58-4616-8f24-0909868c7269] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:44:01.046393724Z [2024-02-22 23:44:01,046: INFO/ForkPoolWorker-3] [457070db-99fe-4016-a6de-6fec0c9cca00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:44:01.432997759Z [2024-02-22 23:44:01,429: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:01.435017247Z [2024-02-22 23:44:01,431: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:44:01.462503397Z [2024-02-22 23:44:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:01.638542828Z [2024-02-22 23:44:01,635: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:44:01.674585721Z [2024-02-22 23:44:01,674: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-22T23:44:01.678487190Z [2024-02-22 23:44:01,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:01.709132158Z [2024-02-22 23:44:01,706: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:01.774062245Z [2024-02-22 23:44:01,773: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:44:01.779837338Z [2024-02-22 23:44:01,779: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:44:01.780009052Z [2024-02-22 23:44:01,779: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:44:01.780178104Z [2024-02-22 23:44:01,779: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-22T23:44:01.780596188Z [2024-02-22 23:44:01,780: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:44:01.877322556Z [2024-02-22 23:44:01,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:44:01.887318183Z [2024-02-22 23:44:01,879: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:02.269748650Z [2024-02-22 23:44:02,269: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:44:02.592019534Z [2024-02-22 23:44:02,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea84fbb7-eff6-4aa5-8fb6-3c564f1c6186] succeeded in 1.5741210989999672s: None 2024-02-22T23:44:03.276098812Z [2024-02-22 23:44:03,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fc5f748-ff49-4b7a-bebd-1b80b98cfbeb] succeeded in 2.258931194999832s: None 2024-02-22T23:44:03.332556125Z [2024-02-22 23:44:03,332: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-22T23:44:03.336044992Z [2024-02-22 23:44:03,335: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:03.359531913Z [2024-02-22 23:44:03,359: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-22T23:44:03.360164171Z [2024-02-22 23:44:03,359: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-22T23:44:03.361628289Z [2024-02-22 23:44:03,361: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:03.361776154Z [2024-02-22 23:44:03,361: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:03.361970204Z [2024-02-22 23:44:03,361: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:03.362103164Z [2024-02-22 23:44:03,361: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-22T23:44:03.362576555Z [2024-02-22 23:44:03,362: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:44:03.362638775Z [2024-02-22 23:44:03,362: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:03.363135880Z [2024-02-22 23:44:03,362: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:03.390390622Z [2024-02-22 23:44:03,390: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-22T23:44:03.391785794Z [2024-02-22 23:44:03,391: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:03.391800845Z [2024-02-22 23:44:03,391: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:03.391938634Z [2024-02-22 23:44:03,391: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:03.391975632Z [2024-02-22 23:44:03,391: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-22T23:44:03.392400498Z [2024-02-22 23:44:03,392: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:44:03.392780466Z [2024-02-22 23:44:03,392: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:03.462001587Z [2024-02-22 23:44:03,461: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:44:03.465528698Z [2024-02-22 23:44:03,465: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:03.477939599Z [2024-02-22 23:44:03,477: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:44:03.496031312Z [2024-02-22 23:44:03,495: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:44:03.497829588Z [2024-02-22 23:44:03,497: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:03.497950541Z [2024-02-22 23:44:03,497: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:03.498131701Z [2024-02-22 23:44:03,497: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:03.498253610Z [2024-02-22 23:44:03,498: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:44:03.498558751Z [2024-02-22 23:44:03,498: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:44:03.498641987Z [2024-02-22 23:44:03,498: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:03.504968518Z [2024-02-22 23:44:03,504: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:44:03.505203239Z [2024-02-22 23:44:03,505: WARNING/ForkPoolWorker-1] Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:03.506237377Z [2024-02-22 23:44:03,505: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:03.511938742Z [2024-02-22 23:44:03,511: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:44:03.514595453Z [2024-02-22 23:44:03,514: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:03.545633166Z [2024-02-22 23:44:03,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:44:03.548422723Z [2024-02-22 23:44:03,548: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:03.548564366Z [2024-02-22 23:44:03,548: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:03.548826230Z [2024-02-22 23:44:03,548: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:03.549086136Z [2024-02-22 23:44:03,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:44:03.549631788Z [2024-02-22 23:44:03,549: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:44:03.550558446Z [2024-02-22 23:44:03,549: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:03.555908000Z [2024-02-22 23:44:03,554: ERROR/ForkPoolWorker-1] [44b50391-da02-46fb-93aa-06941d7757ab] Failed to execute task Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:44:03.555935882Z Traceback (most recent call last): 2024-02-22T23:44:03.555942626Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:44:03.555947939Z args.func(args) 2024-02-22T23:44:03.555953143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:44:03.555958139Z return func(*args, **kwargs) 2024-02-22T23:44:03.555962970Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:44:03.555967482Z return f(*args, **kwargs) 2024-02-22T23:44:03.555971908Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:44:03.555976296Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:44:03.555980680Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:44:03.555985199Z raise AirflowException( 2024-02-22T23:44:03.555990300Z airflow.exceptions.AirflowException: Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:44:03.591317051Z [2024-02-22 23:44:03,590: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44b50391-da02-46fb-93aa-06941d7757ab] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 44b50391-da02-46fb-93aa-06941d7757ab') 2024-02-22T23:44:03.591336156Z Traceback (most recent call last): 2024-02-22T23:44:03.591354699Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:44:03.591357906Z R = retval = fun(*args, **kwargs) 2024-02-22T23:44:03.591361034Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:44:03.591364156Z return self.run(*args, **kwargs) 2024-02-22T23:44:03.591369431Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:44:03.591373568Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:44:03.591376825Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:44:03.591380783Z raise AirflowException(msg) 2024-02-22T23:44:03.591384731Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 44b50391-da02-46fb-93aa-06941d7757ab 2024-02-22T23:44:03.701423368Z [2024-02-22 23:44:03,701: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:44:03.704891599Z [2024-02-22 23:44:03,704: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:03.727842447Z [2024-02-22 23:44:03,727: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:44:03.729756606Z [2024-02-22 23:44:03,729: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:03.729955833Z [2024-02-22 23:44:03,729: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:03.730182216Z [2024-02-22 23:44:03,729: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:03.730318469Z [2024-02-22 23:44:03,730: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:44:03.730671035Z [2024-02-22 23:44:03,730: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:44:03.730817564Z [2024-02-22 23:44:03,730: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:03.737109949Z [2024-02-22 23:44:03,736: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:03.738033034Z [2024-02-22 23:44:03,737: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:03.739098646Z [2024-02-22 23:44:03,738: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:44:03.741800688Z [2024-02-22 23:44:03,741: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:03.760562945Z [2024-02-22 23:44:03,760: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:44:03.762307359Z [2024-02-22 23:44:03,762: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:03.762676963Z [2024-02-22 23:44:03,762: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:03.762902663Z [2024-02-22 23:44:03,762: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:03.763020974Z [2024-02-22 23:44:03,762: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:44:03.763306591Z [2024-02-22 23:44:03,763: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:44:03.763415112Z [2024-02-22 23:44:03,763: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:03.767818396Z [2024-02-22 23:44:03,767: ERROR/ForkPoolWorker-2] [9aa3d999-2ca2-4800-8f60-b74528707beb] Failed to execute task Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:44:03.767835143Z Traceback (most recent call last): 2024-02-22T23:44:03.767839045Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:44:03.767842707Z args.func(args) 2024-02-22T23:44:03.767846628Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:44:03.767850428Z return func(*args, **kwargs) 2024-02-22T23:44:03.767853515Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:44:03.767856643Z return f(*args, **kwargs) 2024-02-22T23:44:03.767860336Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:44:03.767865492Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:44:03.767869980Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:44:03.767878049Z raise AirflowException( 2024-02-22T23:44:03.767885444Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:44:03.806259093Z [2024-02-22 23:44:03,805: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9aa3d999-2ca2-4800-8f60-b74528707beb] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9aa3d999-2ca2-4800-8f60-b74528707beb') 2024-02-22T23:44:03.806277046Z Traceback (most recent call last): 2024-02-22T23:44:03.806281370Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:44:03.806284643Z R = retval = fun(*args, **kwargs) 2024-02-22T23:44:03.806287896Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:44:03.806291023Z return self.run(*args, **kwargs) 2024-02-22T23:44:03.806295122Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:44:03.806299111Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:44:03.806302280Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:44:03.806305921Z raise AirflowException(msg) 2024-02-22T23:44:03.806310033Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9aa3d999-2ca2-4800-8f60-b74528707beb 2024-02-22T23:44:05.362984176Z [2024-02-22 23:44:05,361: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[ccb77e57-9c58-4616-8f24-0909868c7269] succeeded in 4.330460265999818s: None 2024-02-22T23:44:05.925773754Z [2024-02-22 23:44:05,925: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[457070db-99fe-4016-a6de-6fec0c9cca00] succeeded in 4.894385564000004s: None 2024-02-22T23:44:14.431500807Z [2024-02-22 23:44:14,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57c48bd0-02cf-4a26-8858-85550424d0bd] received 2024-02-22T23:44:14.440412027Z [2024-02-22 23:44:14,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd28531c-3645-4dff-947a-ec5b7ebf8852] received 2024-02-22T23:44:14.442125703Z [2024-02-22 23:44:14,441: INFO/ForkPoolWorker-15] [57c48bd0-02cf-4a26-8858-85550424d0bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:44:14.453776514Z [2024-02-22 23:44:14,453: INFO/ForkPoolWorker-16] [bd28531c-3645-4dff-947a-ec5b7ebf8852] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:44:14.772012983Z [2024-02-22 23:44:14,768: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:14.850217485Z [2024-02-22 23:44:14,847: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:15.925396177Z [2024-02-22 23:44:15,924: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:44:15.928584351Z [2024-02-22 23:44:15,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:15.928614584Z [2024-02-22 23:44:15,928: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:44:15.931598087Z [2024-02-22 23:44:15,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:15.956817395Z [2024-02-22 23:44:15,956: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:44:15.958189500Z [2024-02-22 23:44:15,957: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:44:15.958550131Z [2024-02-22 23:44:15,958: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:15.958740623Z [2024-02-22 23:44:15,958: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:15.959010096Z [2024-02-22 23:44:15,958: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:15.959161693Z [2024-02-22 23:44:15,958: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:44:15.959625598Z [2024-02-22 23:44:15,959: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:44:15.959800014Z [2024-02-22 23:44:15,959: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:15.960118696Z [2024-02-22 23:44:15,959: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:15.960237834Z [2024-02-22 23:44:15,960: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:15.960644233Z [2024-02-22 23:44:15,960: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:15.960801575Z [2024-02-22 23:44:15,960: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:44:15.961217579Z [2024-02-22 23:44:15,961: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:44:15.961354966Z [2024-02-22 23:44:15,961: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:15.965807233Z [2024-02-22 23:44:15,965: WARNING/ForkPoolWorker-15] Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:15.966638199Z [2024-02-22 23:44:15,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:44:15.967455117Z [2024-02-22 23:44:15,967: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:44:15.970015814Z [2024-02-22 23:44:15,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:15.973564597Z [2024-02-22 23:44:15,973: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:15.974720506Z [2024-02-22 23:44:15,973: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:44:15.975827946Z [2024-02-22 23:44:15,975: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:44:15.979952913Z [2024-02-22 23:44:15,979: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:44:15.984915048Z [2024-02-22 23:44:15,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:44:15.987072527Z [2024-02-22 23:44:15,986: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:15.987574722Z [2024-02-22 23:44:15,987: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:15.987843145Z [2024-02-22 23:44:15,987: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:15.987991405Z [2024-02-22 23:44:15,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:44:15.988393783Z [2024-02-22 23:44:15,988: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:44:15.988542307Z [2024-02-22 23:44:15,988: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:15.992109820Z [2024-02-22 23:44:15,991: ERROR/ForkPoolWorker-15] [57c48bd0-02cf-4a26-8858-85550424d0bd] Failed to execute task Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:44:15.992138454Z Traceback (most recent call last): 2024-02-22T23:44:15.992145665Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:44:15.992153066Z args.func(args) 2024-02-22T23:44:15.992159512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:44:15.992165940Z return func(*args, **kwargs) 2024-02-22T23:44:15.992171820Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:44:15.992177650Z return f(*args, **kwargs) 2024-02-22T23:44:15.992183774Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:44:15.992189614Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:44:15.992195383Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:44:15.992201441Z raise AirflowException( 2024-02-22T23:44:15.992209353Z airflow.exceptions.AirflowException: Dag 'vim_status_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:44:15.995456488Z [2024-02-22 23:44:15,995: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:44:15.996747616Z [2024-02-22 23:44:15,996: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:44:15.996869041Z [2024-02-22 23:44:15,996: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:44:15.997040781Z [2024-02-22 23:44:15,996: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:44:15.997111236Z [2024-02-22 23:44:15,997: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:44:15.997449781Z [2024-02-22 23:44:15,997: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:44:15.997559720Z [2024-02-22 23:44:15,997: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:44:16.005987018Z [2024-02-22 23:44:16,005: ERROR/ForkPoolWorker-16] [bd28531c-3645-4dff-947a-ec5b7ebf8852] Failed to execute task Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse.. 2024-02-22T23:44:16.006004995Z Traceback (most recent call last): 2024-02-22T23:44:16.006008708Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-22T23:44:16.006012530Z args.func(args) 2024-02-22T23:44:16.006016289Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-22T23:44:16.006020557Z return func(*args, **kwargs) 2024-02-22T23:44:16.006023946Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-22T23:44:16.006027339Z return f(*args, **kwargs) 2024-02-22T23:44:16.006030392Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-22T23:44:16.006033399Z dag = get_dag(args.subdir, args.dag_id) 2024-02-22T23:44:16.006036359Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-22T23:44:16.006052410Z raise AirflowException( 2024-02-22T23:44:16.006056237Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_aa2dfbc9-1fa2-4ab2-a9b1-3e6f30ef5a87' could not be found; either it does not exist or it failed to parse. 2024-02-22T23:44:16.029402024Z [2024-02-22 23:44:16,028: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57c48bd0-02cf-4a26-8858-85550424d0bd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 57c48bd0-02cf-4a26-8858-85550424d0bd') 2024-02-22T23:44:16.029421217Z Traceback (most recent call last): 2024-02-22T23:44:16.029426367Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:44:16.029430352Z R = retval = fun(*args, **kwargs) 2024-02-22T23:44:16.029434162Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:44:16.029437929Z return self.run(*args, **kwargs) 2024-02-22T23:44:16.029442694Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:44:16.029448921Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:44:16.029452804Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:44:16.029457262Z raise AirflowException(msg) 2024-02-22T23:44:16.029485758Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 57c48bd0-02cf-4a26-8858-85550424d0bd 2024-02-22T23:44:16.039937082Z [2024-02-22 23:44:16,039: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd28531c-3645-4dff-947a-ec5b7ebf8852] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bd28531c-3645-4dff-947a-ec5b7ebf8852') 2024-02-22T23:44:16.039955483Z Traceback (most recent call last): 2024-02-22T23:44:16.039961006Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-22T23:44:16.039965694Z R = retval = fun(*args, **kwargs) 2024-02-22T23:44:16.039970127Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-22T23:44:16.039974875Z return self.run(*args, **kwargs) 2024-02-22T23:44:16.039979874Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-22T23:44:16.039984635Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-22T23:44:16.039988985Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-22T23:44:16.039993491Z raise AirflowException(msg) 2024-02-22T23:44:16.039998106Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bd28531c-3645-4dff-947a-ec5b7ebf8852 2024-02-22T23:45:00.494293445Z [2024-02-22 23:45:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b1b5804-7edc-4a69-8f8b-0fb46170bcdf] received 2024-02-22T23:45:00.499461780Z [2024-02-22 23:45:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7d487b1-832d-4bfa-89ef-ff3fbe5c4e2b] received 2024-02-22T23:45:00.504405583Z [2024-02-22 23:45:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb4f630e-96e1-4d1c-b72f-90862049fcd1] received 2024-02-22T23:45:00.508357453Z [2024-02-22 23:45:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bd099c4-c484-41e5-8946-4bd6e6fc2d11] received 2024-02-22T23:45:00.509441506Z [2024-02-22 23:45:00,509: INFO/ForkPoolWorker-15] [4b1b5804-7edc-4a69-8f8b-0fb46170bcdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:45:00.512707052Z [2024-02-22 23:45:00,512: INFO/ForkPoolWorker-16] [e7d487b1-832d-4bfa-89ef-ff3fbe5c4e2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:45:00.514922262Z [2024-02-22 23:45:00,514: INFO/ForkPoolWorker-2] [6bd099c4-c484-41e5-8946-4bd6e6fc2d11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:45:00.529430114Z [2024-02-22 23:45:00,529: INFO/ForkPoolWorker-1] [eb4f630e-96e1-4d1c-b72f-90862049fcd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:45:00.828801499Z [2024-02-22 23:45:00,825: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:45:00.869034049Z [2024-02-22 23:45:00,865: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:45:00.968483301Z [2024-02-22 23:45:00,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:45:01.012513909Z [2024-02-22 23:45:01,008: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:45:01.187962177Z [2024-02-22 23:45:01,187: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:45:01.192984638Z [2024-02-22 23:45:01,192: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:01.240848383Z [2024-02-22 23:45:01,240: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:45:01.242985693Z [2024-02-22 23:45:01,242: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:45:01.243134888Z [2024-02-22 23:45:01,242: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:45:01.243202884Z [2024-02-22 23:45:01,243: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:45:01.243446817Z [2024-02-22 23:45:01,243: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:45:01.360209157Z [2024-02-22 23:45:01,359: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:01.989569111Z [2024-02-22 23:45:01,989: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb4f630e-96e1-4d1c-b72f-90862049fcd1] succeeded in 1.4833774280000398s: None 2024-02-22T23:45:02.134382285Z [2024-02-22 23:45:02,133: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:45:02.137844084Z [2024-02-22 23:45:02,137: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:02.177534559Z [2024-02-22 23:45:02,177: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:45:02.179486631Z [2024-02-22 23:45:02,179: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:45:02.179692616Z [2024-02-22 23:45:02,179: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:45:02.179983442Z [2024-02-22 23:45:02,179: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:45:02.180149101Z [2024-02-22 23:45:02,179: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:45:02.181415859Z [2024-02-22 23:45:02,180: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:45:02.181644148Z [2024-02-22 23:45:02,181: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:45:02.207601934Z [2024-02-22 23:45:02,207: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:45:02.211205184Z [2024-02-22 23:45:02,210: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:02.234781375Z [2024-02-22 23:45:02,234: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:45:02.236180432Z [2024-02-22 23:45:02,235: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:45:02.236360973Z [2024-02-22 23:45:02,236: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:45:02.236584617Z [2024-02-22 23:45:02,236: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:45:02.236744502Z [2024-02-22 23:45:02,236: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:45:02.237243218Z [2024-02-22 23:45:02,236: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:45:02.237408159Z [2024-02-22 23:45:02,237: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:45:02.290082415Z [2024-02-22 23:45:02,289: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:02.312965885Z [2024-02-22 23:45:02,312: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:45:02.316321113Z [2024-02-22 23:45:02,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:02.342385404Z [2024-02-22 23:45:02,342: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:45:02.348760021Z [2024-02-22 23:45:02,348: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:45:02.348861260Z [2024-02-22 23:45:02,348: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:45:02.349092024Z [2024-02-22 23:45:02,348: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:45:02.349242607Z [2024-02-22 23:45:02,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:45:02.349740868Z [2024-02-22 23:45:02,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:45:02.349888649Z [2024-02-22 23:45:02,349: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:45:02.372856914Z [2024-02-22 23:45:02,372: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:02.484385414Z [2024-02-22 23:45:02,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:03.132783116Z [2024-02-22 23:45:03,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b1b5804-7edc-4a69-8f8b-0fb46170bcdf] succeeded in 2.6359690189999583s: None 2024-02-22T23:45:03.522702264Z [2024-02-22 23:45:03,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ea1e3b2-b3e0-48d0-8b63-637b22ca5e98] received 2024-02-22T23:45:03.531591471Z [2024-02-22 23:45:03,531: INFO/ForkPoolWorker-15] [0ea1e3b2-b3e0-48d0-8b63-637b22ca5e98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:45:03.884147498Z [2024-02-22 23:45:03,883: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6bd099c4-c484-41e5-8946-4bd6e6fc2d11] succeeded in 3.3740743630000907s: None 2024-02-22T23:45:03.996710930Z [2024-02-22 23:45:03,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:45:04.209734373Z [2024-02-22 23:45:04,208: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7d487b1-832d-4bfa-89ef-ff3fbe5c4e2b] succeeded in 3.7071212759999526s: None 2024-02-22T23:45:05.211184140Z [2024-02-22 23:45:05,210: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:45:05.214802627Z [2024-02-22 23:45:05,214: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:05.234468375Z [2024-02-22 23:45:05,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:45:05.236236379Z [2024-02-22 23:45:05,235: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:45:05.236419006Z [2024-02-22 23:45:05,236: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:45:05.236679828Z [2024-02-22 23:45:05,236: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:45:05.236877706Z [2024-02-22 23:45:05,236: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:45:05.237286095Z [2024-02-22 23:45:05,237: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:45:05.237495822Z [2024-02-22 23:45:05,237: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:45:05.324559873Z [2024-02-22 23:45:05,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:06.007659578Z [2024-02-22 23:45:06,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fda848b-2df7-4d68-9aa2-21a802396001] received 2024-02-22T23:45:06.012419241Z [2024-02-22 23:45:06,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ea1e3b2-b3e0-48d0-8b63-637b22ca5e98] succeeded in 2.486409330000015s: None 2024-02-22T23:45:06.014731602Z [2024-02-22 23:45:06,014: INFO/ForkPoolWorker-16] [8fda848b-2df7-4d68-9aa2-21a802396001] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:45:06.332728263Z [2024-02-22 23:45:06,329: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:45:07.459358021Z [2024-02-22 23:45:07,458: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:45:07.463032583Z [2024-02-22 23:45:07,462: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:07.482205254Z [2024-02-22 23:45:07,481: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:45:07.483639168Z [2024-02-22 23:45:07,483: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:45:07.483771577Z [2024-02-22 23:45:07,483: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:45:07.483957080Z [2024-02-22 23:45:07,483: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:45:07.484080071Z [2024-02-22 23:45:07,483: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:45:07.484388355Z [2024-02-22 23:45:07,484: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:45:07.484462692Z [2024-02-22 23:45:07,484: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:45:07.573185747Z [2024-02-22 23:45:07,572: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:08.101806102Z [2024-02-22 23:45:08,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[047d842f-f0ff-44aa-adef-9a7683791a39] received 2024-02-22T23:45:08.113076274Z [2024-02-22 23:45:08,112: INFO/ForkPoolWorker-15] [047d842f-f0ff-44aa-adef-9a7683791a39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-22T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:45:08.169015309Z [2024-02-22 23:45:08,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fda848b-2df7-4d68-9aa2-21a802396001] succeeded in 2.159519550000141s: None 2024-02-22T23:45:08.401169745Z [2024-02-22 23:45:08,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:45:09.642286164Z [2024-02-22 23:45:09,641: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:45:09.645686557Z [2024-02-22 23:45:09,645: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:45:09.668316100Z [2024-02-22 23:45:09,668: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:45:09.669703637Z [2024-02-22 23:45:09,669: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:45:09.669717915Z [2024-02-22 23:45:09,669: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:45:09.669906103Z [2024-02-22 23:45:09,669: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:45:09.669962489Z [2024-02-22 23:45:09,669: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:45:09.670234634Z [2024-02-22 23:45:09,670: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:45:09.670318638Z [2024-02-22 23:45:09,670: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:45:09.763797660Z [2024-02-22 23:45:09,763: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:45:10.363049725Z [2024-02-22 23:45:10,362: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[047d842f-f0ff-44aa-adef-9a7683791a39] succeeded in 2.2571768809998503s: None 2024-02-22T23:46:00.354386162Z [2024-02-22 23:46:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48285460-107e-4610-b1c8-072ed63ac824] received 2024-02-22T23:46:00.356817475Z [2024-02-22 23:46:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1eaffdc7-7859-4e37-9aea-975e08980fac] received 2024-02-22T23:46:00.361805542Z [2024-02-22 23:46:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0ff6453-f940-4bea-aeb0-e762f92cd056] received 2024-02-22T23:46:00.370918229Z [2024-02-22 23:46:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0a78bc7-3414-42fd-ac5b-19b837598cff] received 2024-02-22T23:46:00.371909924Z [2024-02-22 23:46:00,371: INFO/ForkPoolWorker-1] [f0ff6453-f940-4bea-aeb0-e762f92cd056] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:46:00.401581638Z [2024-02-22 23:46:00,401: INFO/ForkPoolWorker-2] [c0a78bc7-3414-42fd-ac5b-19b837598cff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:46:00.403423311Z [2024-02-22 23:46:00,403: INFO/ForkPoolWorker-15] [48285460-107e-4610-b1c8-072ed63ac824] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:46:00.408968286Z [2024-02-22 23:46:00,407: INFO/ForkPoolWorker-16] [1eaffdc7-7859-4e37-9aea-975e08980fac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:46:01.019072868Z [2024-02-22 23:46:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:46:01.155063989Z [2024-02-22 23:46:01,151: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:46:01.315188784Z [2024-02-22 23:46:01,305: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:46:01.421776323Z [2024-02-22 23:46:01,420: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:46:01.427552394Z [2024-02-22 23:46:01,426: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:46:01.442715601Z [2024-02-22 23:46:01,437: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:46:01.491400643Z [2024-02-22 23:46:01,491: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:46:01.493636531Z [2024-02-22 23:46:01,493: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:46:01.494948271Z [2024-02-22 23:46:01,493: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:46:01.494964695Z [2024-02-22 23:46:01,493: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:46:01.494969832Z [2024-02-22 23:46:01,494: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:46:01.800013009Z [2024-02-22 23:46:01,799: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:46:02.262911691Z [2024-02-22 23:46:02,262: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:46:03.500077542Z [2024-02-22 23:46:03,499: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0ff6453-f940-4bea-aeb0-e762f92cd056] succeeded in 3.136446266999883s: None 2024-02-22T23:46:03.551442462Z [2024-02-22 23:46:03,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48285460-107e-4610-b1c8-072ed63ac824] succeeded in 3.191802286999973s: None 2024-02-22T23:46:04.200696086Z [2024-02-22 23:46:04,200: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:46:04.204983852Z [2024-02-22 23:46:04,204: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:46:04.237683074Z [2024-02-22 23:46:04,237: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:46:04.240024100Z [2024-02-22 23:46:04,239: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:46:04.240280716Z [2024-02-22 23:46:04,239: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:46:04.240516880Z [2024-02-22 23:46:04,240: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:46:04.240638089Z [2024-02-22 23:46:04,240: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:46:04.241373821Z [2024-02-22 23:46:04,241: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:46:04.241524228Z [2024-02-22 23:46:04,241: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:46:04.466502659Z [2024-02-22 23:46:04,466: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:46:04.888475185Z [2024-02-22 23:46:04,875: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:46:04.888504051Z [2024-02-22 23:46:04,879: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:46:04.915852915Z [2024-02-22 23:46:04,915: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:46:04.917395613Z [2024-02-22 23:46:04,917: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:46:04.917596214Z [2024-02-22 23:46:04,917: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:46:04.917806546Z [2024-02-22 23:46:04,917: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:46:04.917947204Z [2024-02-22 23:46:04,917: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:46:04.921541304Z [2024-02-22 23:46:04,918: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:46:04.921720056Z [2024-02-22 23:46:04,921: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:46:05.056110938Z [2024-02-22 23:46:05,055: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:46:06.673077197Z [2024-02-22 23:46:06,672: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1eaffdc7-7859-4e37-9aea-975e08980fac] succeeded in 6.31221893299994s: None 2024-02-22T23:46:06.732091791Z [2024-02-22 23:46:06,731: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c0a78bc7-3414-42fd-ac5b-19b837598cff] succeeded in 6.338179803000003s: None 2024-02-22T23:47:01.231837207Z [2024-02-22 23:47:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68ebcb7d-ac1a-46c7-9471-fb5dc2acc540] received 2024-02-22T23:47:01.233674898Z [2024-02-22 23:47:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0342c5f-957a-4f76-9602-23094b63a091] received 2024-02-22T23:47:01.235182507Z [2024-02-22 23:47:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb08a278-334f-4961-b673-cffe8309cc21] received 2024-02-22T23:47:01.248382372Z [2024-02-22 23:47:01,247: INFO/ForkPoolWorker-15] [68ebcb7d-ac1a-46c7-9471-fb5dc2acc540] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:47:01.253622986Z [2024-02-22 23:47:01,253: INFO/ForkPoolWorker-1] [eb08a278-334f-4961-b673-cffe8309cc21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:47:01.260870668Z [2024-02-22 23:47:01,260: INFO/ForkPoolWorker-16] [f0342c5f-957a-4f76-9602-23094b63a091] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:47:01.555006647Z [2024-02-22 23:47:01,551: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:47:01.617832479Z [2024-02-22 23:47:01,614: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:47:01.635912270Z [2024-02-22 23:47:01,632: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:47:01.724749408Z [2024-02-22 23:47:01,724: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:47:01.729056918Z [2024-02-22 23:47:01,728: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:47:01.758064681Z [2024-02-22 23:47:01,757: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:47:01.759616703Z [2024-02-22 23:47:01,759: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:47:01.759656075Z [2024-02-22 23:47:01,759: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:47:01.759802488Z [2024-02-22 23:47:01,759: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:47:01.760048612Z [2024-02-22 23:47:01,759: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:47:01.868310850Z [2024-02-22 23:47:01,867: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:47:02.524205701Z [2024-02-22 23:47:02,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb08a278-334f-4961-b673-cffe8309cc21] succeeded in 1.2848724110001513s: None 2024-02-22T23:47:02.919299239Z [2024-02-22 23:47:02,918: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:47:02.923654208Z [2024-02-22 23:47:02,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:47:02.958110566Z [2024-02-22 23:47:02,957: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:47:02.959733655Z [2024-02-22 23:47:02,959: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:47:02.959947919Z [2024-02-22 23:47:02,959: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:47:02.960156069Z [2024-02-22 23:47:02,959: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:47:02.960216903Z [2024-02-22 23:47:02,960: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:47:02.960541526Z [2024-02-22 23:47:02,960: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:47:02.961041759Z [2024-02-22 23:47:02,960: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:47:02.963035201Z [2024-02-22 23:47:02,962: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:47:02.967934764Z [2024-02-22 23:47:02,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:47:02.987984759Z [2024-02-22 23:47:02,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:47:02.989960568Z [2024-02-22 23:47:02,989: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:47:02.989977126Z [2024-02-22 23:47:02,989: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:47:02.990141144Z [2024-02-22 23:47:02,989: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:47:02.990199871Z [2024-02-22 23:47:02,990: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:47:02.990607358Z [2024-02-22 23:47:02,990: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:47:02.990626581Z [2024-02-22 23:47:02,990: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:47:03.059809308Z [2024-02-22 23:47:03,059: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:47:03.076795952Z [2024-02-22 23:47:03,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:47:05.556314913Z [2024-02-22 23:47:05,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68ebcb7d-ac1a-46c7-9471-fb5dc2acc540] succeeded in 4.321798989999934s: None 2024-02-22T23:47:06.065575860Z [2024-02-22 23:47:06,065: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0342c5f-957a-4f76-9602-23094b63a091] succeeded in 4.826811311000029s: None 2024-02-22T23:48:01.094416922Z [2024-02-22 23:48:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cb8ddd6-4e11-4337-91f1-7b6311232349] received 2024-02-22T23:48:01.096187012Z [2024-02-22 23:48:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[791615cd-f149-461b-8afc-eb893f2733b1] received 2024-02-22T23:48:01.097935464Z [2024-02-22 23:48:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8b0e46a-1263-4140-9692-5549e3e7f89b] received 2024-02-22T23:48:01.099492865Z [2024-02-22 23:48:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdb4a632-43dd-49fc-8963-6b0a3ea71d76] received 2024-02-22T23:48:01.109236671Z [2024-02-22 23:48:01,108: INFO/ForkPoolWorker-2] [cdb4a632-43dd-49fc-8963-6b0a3ea71d76] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:48:01.110481221Z [2024-02-22 23:48:01,109: INFO/ForkPoolWorker-1] [e8b0e46a-1263-4140-9692-5549e3e7f89b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:48:01.111093927Z [2024-02-22 23:48:01,110: INFO/ForkPoolWorker-16] [791615cd-f149-461b-8afc-eb893f2733b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:48:01.111486200Z [2024-02-22 23:48:01,111: INFO/ForkPoolWorker-15] [6cb8ddd6-4e11-4337-91f1-7b6311232349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:48:01.459546980Z [2024-02-22 23:48:01,456: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:48:01.518148605Z [2024-02-22 23:48:01,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:48:01.634558557Z [2024-02-22 23:48:01,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:48:01.691263036Z [2024-02-22 23:48:01,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:48:01.934275000Z [2024-02-22 23:48:01,933: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-22T23:48:01.939734901Z [2024-02-22 23:48:01,939: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:48:01.970864896Z [2024-02-22 23:48:01,970: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:48:01.975910295Z [2024-02-22 23:48:01,975: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:48:01.976397094Z [2024-02-22 23:48:01,976: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:48:01.976537247Z [2024-02-22 23:48:01,976: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-22T23:48:01.976972004Z [2024-02-22 23:48:01,976: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:48:02.091420236Z [2024-02-22 23:48:02,091: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:48:02.174158552Z [2024-02-22 23:48:02,173: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:48:02.891737275Z [2024-02-22 23:48:02,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e8b0e46a-1263-4140-9692-5549e3e7f89b] succeeded in 1.7914103690000047s: None 2024-02-22T23:48:03.055832310Z [2024-02-22 23:48:03,055: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cdb4a632-43dd-49fc-8963-6b0a3ea71d76] succeeded in 1.9545636430000286s: None 2024-02-22T23:48:03.223959396Z [2024-02-22 23:48:03,223: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:48:03.227563052Z [2024-02-22 23:48:03,227: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:48:03.251936950Z [2024-02-22 23:48:03,251: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:48:03.253174317Z [2024-02-22 23:48:03,252: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:48:03.253932125Z [2024-02-22 23:48:03,253: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:48:03.253943133Z [2024-02-22 23:48:03,253: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:48:03.253947600Z [2024-02-22 23:48:03,253: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:48:03.253951100Z [2024-02-22 23:48:03,253: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:48:03.253954425Z [2024-02-22 23:48:03,253: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:48:03.342892136Z [2024-02-22 23:48:03,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:48:03.537821788Z [2024-02-22 23:48:03,537: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:48:03.541817142Z [2024-02-22 23:48:03,541: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:48:03.581570874Z [2024-02-22 23:48:03,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:48:03.589901099Z [2024-02-22 23:48:03,588: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:48:03.589931608Z [2024-02-22 23:48:03,589: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:48:03.590033886Z [2024-02-22 23:48:03,589: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:48:03.590076948Z [2024-02-22 23:48:03,590: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:48:03.590388853Z [2024-02-22 23:48:03,590: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:48:03.590397676Z [2024-02-22 23:48:03,590: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:48:03.677520853Z [2024-02-22 23:48:03,677: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:48:04.847677696Z [2024-02-22 23:48:04,847: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[791615cd-f149-461b-8afc-eb893f2733b1] succeeded in 3.749112777999926s: None 2024-02-22T23:48:05.732440587Z [2024-02-22 23:48:05,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cb8ddd6-4e11-4337-91f1-7b6311232349] succeeded in 4.634648495999954s: None 2024-02-22T23:49:01.006126267Z [2024-02-22 23:49:01,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc764ba3-0e66-4ff3-8d40-888e3e61edec] received 2024-02-22T23:49:01.009294322Z [2024-02-22 23:49:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e758f6c6-2a55-48f6-adfb-b3527b1e16ff] received 2024-02-22T23:49:01.013997940Z [2024-02-22 23:49:01,013: INFO/ForkPoolWorker-15] [cc764ba3-0e66-4ff3-8d40-888e3e61edec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:49:01.015889728Z [2024-02-22 23:49:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[865d67d6-23d4-420a-9473-935aa8a573fe] received 2024-02-22T23:49:01.023709460Z [2024-02-22 23:49:01,023: INFO/ForkPoolWorker-16] [e758f6c6-2a55-48f6-adfb-b3527b1e16ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:49:01.029995079Z [2024-02-22 23:49:01,029: INFO/ForkPoolWorker-1] [865d67d6-23d4-420a-9473-935aa8a573fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:49:01.363463722Z [2024-02-22 23:49:01,359: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:49:01.370486492Z [2024-02-22 23:49:01,367: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:49:01.382918586Z [2024-02-22 23:49:01,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:49:01.564399985Z [2024-02-22 23:49:01,563: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:49:01.569056485Z [2024-02-22 23:49:01,568: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:49:01.602485082Z [2024-02-22 23:49:01,602: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:49:01.603781438Z [2024-02-22 23:49:01,603: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:49:01.603833381Z [2024-02-22 23:49:01,603: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:49:01.603889397Z [2024-02-22 23:49:01,603: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:49:01.604129410Z [2024-02-22 23:49:01,604: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:49:01.717671680Z [2024-02-22 23:49:01,717: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:49:02.322675925Z [2024-02-22 23:49:02,322: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[865d67d6-23d4-420a-9473-935aa8a573fe] succeeded in 1.3040235120001853s: None 2024-02-22T23:49:02.605073437Z [2024-02-22 23:49:02,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:49:02.605105808Z [2024-02-22 23:49:02,604: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:49:02.608801599Z [2024-02-22 23:49:02,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:49:02.608831281Z [2024-02-22 23:49:02,608: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:49:02.632651742Z [2024-02-22 23:49:02,632: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:49:02.646663639Z [2024-02-22 23:49:02,634: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:49:02.646687994Z [2024-02-22 23:49:02,634: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:49:02.646696842Z [2024-02-22 23:49:02,634: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:49:02.646701272Z [2024-02-22 23:49:02,634: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:49:02.646723108Z [2024-02-22 23:49:02,634: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:49:02.646726497Z [2024-02-22 23:49:02,635: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:49:02.651583978Z [2024-02-22 23:49:02,650: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:49:02.658478711Z [2024-02-22 23:49:02,656: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:49:02.658506281Z [2024-02-22 23:49:02,656: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:49:02.658511484Z [2024-02-22 23:49:02,656: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:49:02.658516116Z [2024-02-22 23:49:02,657: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:49:02.658519941Z [2024-02-22 23:49:02,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:49:02.658537666Z [2024-02-22 23:49:02,657: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:49:02.736549244Z [2024-02-22 23:49:02,736: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:49:02.769693198Z [2024-02-22 23:49:02,769: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:49:04.990887774Z [2024-02-22 23:49:04,990: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc764ba3-0e66-4ff3-8d40-888e3e61edec] succeeded in 3.982816201999867s: None 2024-02-22T23:49:05.477887916Z [2024-02-22 23:49:05,477: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e758f6c6-2a55-48f6-adfb-b3527b1e16ff] succeeded in 4.465706766000039s: None 2024-02-22T23:50:01.081922622Z [2024-02-22 23:50:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53c9da9a-94d3-4dac-8400-92ae00005899] received 2024-02-22T23:50:01.090754921Z [2024-02-22 23:50:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c14cb0f3-5301-498c-a432-72bc282442dd] received 2024-02-22T23:50:01.096601580Z [2024-02-22 23:50:01,096: INFO/ForkPoolWorker-16] [c14cb0f3-5301-498c-a432-72bc282442dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:50:01.098475211Z [2024-02-22 23:50:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4ef165d-bd94-416d-aee0-5169da198c5f] received 2024-02-22T23:50:01.100471816Z [2024-02-22 23:50:01,100: INFO/ForkPoolWorker-15] [53c9da9a-94d3-4dac-8400-92ae00005899] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:50:01.112641186Z [2024-02-22 23:50:01,112: INFO/ForkPoolWorker-1] [d4ef165d-bd94-416d-aee0-5169da198c5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:50:01.114312464Z [2024-02-22 23:50:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c665a60b-4194-492f-b1ca-47af1cfc6540] received 2024-02-22T23:50:01.119172683Z [2024-02-22 23:50:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2253ca6b-0657-4f21-9b0c-ce243cad8235] received 2024-02-22T23:50:01.135701033Z [2024-02-22 23:50:01,134: INFO/ForkPoolWorker-2] [c665a60b-4194-492f-b1ca-47af1cfc6540] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:50:01.141319673Z [2024-02-22 23:50:01,140: INFO/ForkPoolWorker-3] [2253ca6b-0657-4f21-9b0c-ce243cad8235] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:50:01.514075015Z [2024-02-22 23:50:01,510: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:50:01.639141752Z [2024-02-22 23:50:01,634: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:50:01.680157126Z [2024-02-22 23:50:01,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:50:01.714549390Z [2024-02-22 23:50:01,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:50:01.754369664Z [2024-02-22 23:50:01,738: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:50:01.944981366Z [2024-02-22 23:50:01,944: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:50:01.952842202Z [2024-02-22 23:50:01,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:02.004218208Z [2024-02-22 23:50:02,003: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:50:02.006436106Z [2024-02-22 23:50:02,006: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:50:02.006603558Z [2024-02-22 23:50:02,006: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:50:02.006730760Z [2024-02-22 23:50:02,006: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:50:02.007079196Z [2024-02-22 23:50:02,006: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:50:02.125291249Z [2024-02-22 23:50:02,125: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:02.272867691Z [2024-02-22 23:50:02,272: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:02.822675553Z [2024-02-22 23:50:02,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4ef165d-bd94-416d-aee0-5169da198c5f] succeeded in 1.7147482670000045s: None 2024-02-22T23:50:02.951414557Z [2024-02-22 23:50:02,951: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2253ca6b-0657-4f21-9b0c-ce243cad8235] succeeded in 1.824515619000067s: None 2024-02-22T23:50:02.978090695Z [2024-02-22 23:50:02,977: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:50:02.981952845Z [2024-02-22 23:50:02,981: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:03.016302560Z [2024-02-22 23:50:03,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:50:03.018619786Z [2024-02-22 23:50:03,018: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:50:03.018791173Z [2024-02-22 23:50:03,018: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:50:03.019059897Z [2024-02-22 23:50:03,018: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:50:03.019254962Z [2024-02-22 23:50:03,019: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:50:03.019671255Z [2024-02-22 23:50:03,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:50:03.019909446Z [2024-02-22 23:50:03,019: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:50:03.127665641Z [2024-02-22 23:50:03,127: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:03.368465622Z [2024-02-22 23:50:03,368: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:50:03.371907923Z [2024-02-22 23:50:03,371: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:03.403630787Z [2024-02-22 23:50:03,403: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:50:03.408662758Z [2024-02-22 23:50:03,408: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:50:03.408704975Z [2024-02-22 23:50:03,408: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:50:03.408912651Z [2024-02-22 23:50:03,408: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:50:03.409010104Z [2024-02-22 23:50:03,408: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:50:03.409488410Z [2024-02-22 23:50:03,409: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:50:03.409498807Z [2024-02-22 23:50:03,409: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:50:03.454741110Z [2024-02-22 23:50:03,454: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:50:03.459135372Z [2024-02-22 23:50:03,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:03.486338296Z [2024-02-22 23:50:03,486: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:50:03.488181000Z [2024-02-22 23:50:03,487: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:50:03.488216915Z [2024-02-22 23:50:03,488: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:50:03.488464373Z [2024-02-22 23:50:03,488: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:50:03.488531438Z [2024-02-22 23:50:03,488: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:50:03.488847213Z [2024-02-22 23:50:03,488: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:50:03.489014891Z [2024-02-22 23:50:03,488: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:50:03.501924636Z [2024-02-22 23:50:03,501: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:03.579237316Z [2024-02-22 23:50:03,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:04.192251217Z [2024-02-22 23:50:04,191: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c665a60b-4194-492f-b1ca-47af1cfc6540] succeeded in 3.074717691999922s: None 2024-02-22T23:50:05.098812026Z [2024-02-22 23:50:05,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f11c5f3-8e91-408d-ac56-7f385d9b5fec] received 2024-02-22T23:50:05.106629610Z [2024-02-22 23:50:05,106: INFO/ForkPoolWorker-1] [9f11c5f3-8e91-408d-ac56-7f385d9b5fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:50:05.251292326Z [2024-02-22 23:50:05,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c14cb0f3-5301-498c-a432-72bc282442dd] succeeded in 4.15901043100007s: None 2024-02-22T23:50:05.462517472Z [2024-02-22 23:50:05,456: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:50:06.078532624Z [2024-02-22 23:50:06,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53c9da9a-94d3-4dac-8400-92ae00005899] succeeded in 4.985811461999901s: None 2024-02-22T23:50:06.725128320Z [2024-02-22 23:50:06,724: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:50:06.728515549Z [2024-02-22 23:50:06,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:06.755899417Z [2024-02-22 23:50:06,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:50:06.758687156Z [2024-02-22 23:50:06,758: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:50:06.758808636Z [2024-02-22 23:50:06,758: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:50:06.759042504Z [2024-02-22 23:50:06,758: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:50:06.759115059Z [2024-02-22 23:50:06,758: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:50:06.759489202Z [2024-02-22 23:50:06,759: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:50:06.759566754Z [2024-02-22 23:50:06,759: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:50:06.846642741Z [2024-02-22 23:50:06,846: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:07.488710202Z [2024-02-22 23:50:07,488: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f11c5f3-8e91-408d-ac56-7f385d9b5fec] succeeded in 2.387878700999863s: None 2024-02-22T23:50:07.756670822Z [2024-02-22 23:50:07,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fd11376-6d88-4f8a-a614-13291d247201] received 2024-02-22T23:50:07.767052445Z [2024-02-22 23:50:07,766: INFO/ForkPoolWorker-15] [9fd11376-6d88-4f8a-a614-13291d247201] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:50:08.100172481Z [2024-02-22 23:50:08,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:50:09.348996589Z [2024-02-22 23:50:09,348: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:50:09.352755826Z [2024-02-22 23:50:09,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:09.377295116Z [2024-02-22 23:50:09,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:50:09.378586193Z [2024-02-22 23:50:09,378: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:50:09.378603529Z [2024-02-22 23:50:09,378: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:50:09.378731150Z [2024-02-22 23:50:09,378: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:50:09.378747923Z [2024-02-22 23:50:09,378: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:50:09.379270467Z [2024-02-22 23:50:09,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:50:09.379276254Z [2024-02-22 23:50:09,379: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:50:09.500022905Z [2024-02-22 23:50:09,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:10.154301620Z [2024-02-22 23:50:10,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fd11376-6d88-4f8a-a614-13291d247201] succeeded in 2.3943465009999727s: None 2024-02-22T23:50:11.079139481Z [2024-02-22 23:50:11,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bb570ed-7fa4-464f-b1d3-6115a5756802] received 2024-02-22T23:50:11.101429870Z [2024-02-22 23:50:11,101: INFO/ForkPoolWorker-15] [6bb570ed-7fa4-464f-b1d3-6115a5756802] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-22T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:50:11.414131072Z [2024-02-22 23:50:11,410: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:50:12.526667491Z [2024-02-22 23:50:12,526: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:50:12.529972123Z [2024-02-22 23:50:12,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:50:12.552462551Z [2024-02-22 23:50:12,552: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:50:12.556768140Z [2024-02-22 23:50:12,556: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:50:12.556805427Z [2024-02-22 23:50:12,556: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:50:12.557062125Z [2024-02-22 23:50:12,556: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:50:12.557153953Z [2024-02-22 23:50:12,557: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:50:12.557466846Z [2024-02-22 23:50:12,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:50:12.557544053Z [2024-02-22 23:50:12,557: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:50:12.643408377Z [2024-02-22 23:50:12,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:50:13.195116724Z [2024-02-22 23:50:13,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6bb570ed-7fa4-464f-b1d3-6115a5756802] succeeded in 2.1040200360000654s: None 2024-02-22T23:51:00.394672831Z [2024-02-22 23:51:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57f12e2f-ce41-4250-897b-be9000c745e4] received 2024-02-22T23:51:00.402354685Z [2024-02-22 23:51:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd643d6c-9557-47fb-8f44-f2e1569ecf1c] received 2024-02-22T23:51:00.403213951Z [2024-02-22 23:51:00,402: INFO/ForkPoolWorker-15] [57f12e2f-ce41-4250-897b-be9000c745e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:51:00.409153630Z [2024-02-22 23:51:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bdfa155-3a9f-48b2-b0a2-a49ed6aa9118] received 2024-02-22T23:51:00.415218845Z [2024-02-22 23:51:00,415: INFO/ForkPoolWorker-1] [9bdfa155-3a9f-48b2-b0a2-a49ed6aa9118] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:51:00.417905376Z [2024-02-22 23:51:00,414: INFO/ForkPoolWorker-16] [cd643d6c-9557-47fb-8f44-f2e1569ecf1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:51:00.732022737Z [2024-02-22 23:51:00,726: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:51:00.760547808Z [2024-02-22 23:51:00,757: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:51:00.833211185Z [2024-02-22 23:51:00,828: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:51:00.915402209Z [2024-02-22 23:51:00,914: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-22T23:51:00.919502953Z [2024-02-22 23:51:00,919: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:51:00.937545759Z [2024-02-22 23:51:00,937: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:51:00.938409007Z [2024-02-22 23:51:00,938: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:51:00.938517882Z [2024-02-22 23:51:00,938: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:51:00.938538594Z [2024-02-22 23:51:00,938: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-22T23:51:00.938730936Z [2024-02-22 23:51:00,938: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:51:01.044015840Z [2024-02-22 23:51:01,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:51:01.702887855Z [2024-02-22 23:51:01,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57f12e2f-ce41-4250-897b-be9000c745e4] succeeded in 1.3063962530000026s: None 2024-02-22T23:51:01.853657586Z [2024-02-22 23:51:01,853: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:51:01.857171863Z [2024-02-22 23:51:01,856: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:51:01.884144024Z [2024-02-22 23:51:01,883: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:51:01.885830099Z [2024-02-22 23:51:01,885: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:51:01.885848294Z [2024-02-22 23:51:01,885: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:51:01.886016090Z [2024-02-22 23:51:01,885: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:51:01.886070049Z [2024-02-22 23:51:01,885: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:51:01.886618506Z [2024-02-22 23:51:01,886: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:51:01.886789810Z [2024-02-22 23:51:01,886: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:51:01.970586836Z [2024-02-22 23:51:01,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:51:02.066054141Z [2024-02-22 23:51:02,065: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:51:02.069708337Z [2024-02-22 23:51:02,069: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:51:02.092954570Z [2024-02-22 23:51:02,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:51:02.094537513Z [2024-02-22 23:51:02,094: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:51:02.094706603Z [2024-02-22 23:51:02,094: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:51:02.094996069Z [2024-02-22 23:51:02,094: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:51:02.095249571Z [2024-02-22 23:51:02,094: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:51:02.095546048Z [2024-02-22 23:51:02,095: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:51:02.095758465Z [2024-02-22 23:51:02,095: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:51:02.198274308Z [2024-02-22 23:51:02,197: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:51:03.742899967Z [2024-02-22 23:51:03,742: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9bdfa155-3a9f-48b2-b0a2-a49ed6aa9118] succeeded in 3.3317526549999457s: None 2024-02-22T23:51:03.811151650Z [2024-02-22 23:51:03,810: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd643d6c-9557-47fb-8f44-f2e1569ecf1c] succeeded in 3.4050500630000897s: None 2024-02-22T23:52:00.829609060Z [2024-02-22 23:52:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[189fe367-0ce5-42a4-9fb5-a7170ccc71ce] received 2024-02-22T23:52:00.833919768Z [2024-02-22 23:52:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cff23799-4900-4c58-aa7f-0c17f2e3ce5e] received 2024-02-22T23:52:00.840784803Z [2024-02-22 23:52:00,840: INFO/ForkPoolWorker-15] [189fe367-0ce5-42a4-9fb5-a7170ccc71ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:52:00.841109073Z [2024-02-22 23:52:00,840: INFO/ForkPoolWorker-16] [cff23799-4900-4c58-aa7f-0c17f2e3ce5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:52:00.844051524Z [2024-02-22 23:52:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3de8376e-58dd-4b67-9c3b-9bb123a895c4] received 2024-02-22T23:52:00.851263608Z [2024-02-22 23:52:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bbff987-af1f-4c94-9d1a-6011ab8e5fa4] received 2024-02-22T23:52:00.855508738Z [2024-02-22 23:52:00,855: INFO/ForkPoolWorker-1] [3de8376e-58dd-4b67-9c3b-9bb123a895c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:52:00.863484017Z [2024-02-22 23:52:00,863: INFO/ForkPoolWorker-2] [2bbff987-af1f-4c94-9d1a-6011ab8e5fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:52:01.169946097Z [2024-02-22 23:52:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:52:01.189176489Z [2024-02-22 23:52:01,186: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:52:01.207556625Z [2024-02-22 23:52:01,204: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:52:01.237527703Z [2024-02-22 23:52:01,233: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:52:01.362683502Z [2024-02-22 23:52:01,362: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-22T23:52:01.366423402Z [2024-02-22 23:52:01,365: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:52:01.400183940Z [2024-02-22 23:52:01,399: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:52:01.403869485Z [2024-02-22 23:52:01,403: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:52:01.404272214Z [2024-02-22 23:52:01,403: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:52:01.404540767Z [2024-02-22 23:52:01,404: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-22T23:52:01.404955667Z [2024-02-22 23:52:01,404: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:52:01.514461637Z [2024-02-22 23:52:01,514: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:52:01.543087400Z [2024-02-22 23:52:01,542: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:52:02.281596350Z [2024-02-22 23:52:02,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[189fe367-0ce5-42a4-9fb5-a7170ccc71ce] succeeded in 1.4486190150000766s: None 2024-02-22T23:52:02.319405694Z [2024-02-22 23:52:02,319: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cff23799-4900-4c58-aa7f-0c17f2e3ce5e] succeeded in 1.4829198219999853s: None 2024-02-22T23:52:02.939000073Z [2024-02-22 23:52:02,938: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:52:02.942396524Z [2024-02-22 23:52:02,941: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:52:02.973644377Z [2024-02-22 23:52:02,973: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:52:02.975640417Z [2024-02-22 23:52:02,975: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:52:02.975723632Z [2024-02-22 23:52:02,975: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:52:02.975919591Z [2024-02-22 23:52:02,975: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:52:02.975969730Z [2024-02-22 23:52:02,975: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:52:02.976322316Z [2024-02-22 23:52:02,976: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:52:02.976360993Z [2024-02-22 23:52:02,976: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:52:02.987812780Z [2024-02-22 23:52:02,987: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:52:02.991224052Z [2024-02-22 23:52:02,990: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:52:03.019780473Z [2024-02-22 23:52:03,019: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:52:03.021706336Z [2024-02-22 23:52:03,021: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:52:03.021948284Z [2024-02-22 23:52:03,021: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:52:03.022307691Z [2024-02-22 23:52:03,021: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:52:03.022503615Z [2024-02-22 23:52:03,022: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:52:03.023168437Z [2024-02-22 23:52:03,022: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:52:03.023417502Z [2024-02-22 23:52:03,023: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:52:03.130470737Z [2024-02-22 23:52:03,129: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:52:03.166882034Z [2024-02-22 23:52:03,166: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:52:04.647853025Z [2024-02-22 23:52:04,647: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3de8376e-58dd-4b67-9c3b-9bb123a895c4] succeeded in 3.8011448770000698s: None 2024-02-22T23:52:05.431581025Z [2024-02-22 23:52:05,431: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2bbff987-af1f-4c94-9d1a-6011ab8e5fa4] succeeded in 4.575652151999975s: None 2024-02-22T23:53:00.217364712Z [2024-02-22 23:53:00,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8737d8e9-69b9-43d2-9d87-d2220705b47c] received 2024-02-22T23:53:00.220937021Z [2024-02-22 23:53:00,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2a5f4ec-121a-4901-a1d8-840d8561b25f] received 2024-02-22T23:53:00.227874278Z [2024-02-22 23:53:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9609bc3-6d49-4ea9-817f-0272d7e9f6da] received 2024-02-22T23:53:00.228501894Z [2024-02-22 23:53:00,228: INFO/ForkPoolWorker-15] [8737d8e9-69b9-43d2-9d87-d2220705b47c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:53:00.237803271Z [2024-02-22 23:53:00,237: INFO/ForkPoolWorker-1] [d9609bc3-6d49-4ea9-817f-0272d7e9f6da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:53:00.242950156Z [2024-02-22 23:53:00,240: INFO/ForkPoolWorker-16] [e2a5f4ec-121a-4901-a1d8-840d8561b25f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:53:00.545875919Z [2024-02-22 23:53:00,542: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:53:00.909452776Z [2024-02-22 23:53:00,900: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:53:00.929188249Z [2024-02-22 23:53:00,925: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:53:01.143267545Z [2024-02-22 23:53:01,142: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:53:01.147914447Z [2024-02-22 23:53:01,147: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:53:01.236209841Z [2024-02-22 23:53:01,235: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:53:01.240285287Z [2024-02-22 23:53:01,239: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:53:01.240439089Z [2024-02-22 23:53:01,240: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:53:01.240449803Z [2024-02-22 23:53:01,240: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:53:01.240796272Z [2024-02-22 23:53:01,240: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:53:01.381333387Z [2024-02-22 23:53:01,381: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:53:02.184043690Z [2024-02-22 23:53:02,183: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9609bc3-6d49-4ea9-817f-0272d7e9f6da] succeeded in 1.954418478999969s: None 2024-02-22T23:53:02.305106783Z [2024-02-22 23:53:02,304: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:53:02.308779138Z [2024-02-22 23:53:02,308: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:53:02.375739660Z [2024-02-22 23:53:02,375: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:53:02.386061870Z [2024-02-22 23:53:02,385: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:53:02.386123441Z [2024-02-22 23:53:02,385: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:53:02.386209700Z [2024-02-22 23:53:02,385: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:53:02.386245379Z [2024-02-22 23:53:02,386: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:53:02.386435824Z [2024-02-22 23:53:02,386: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:53:02.386534588Z [2024-02-22 23:53:02,386: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:53:02.496758139Z [2024-02-22 23:53:02,496: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:53:02.609867810Z [2024-02-22 23:53:02,609: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:53:02.614405514Z [2024-02-22 23:53:02,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:53:02.647596827Z [2024-02-22 23:53:02,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:53:02.651745557Z [2024-02-22 23:53:02,651: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:53:02.651768644Z [2024-02-22 23:53:02,651: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:53:02.652074343Z [2024-02-22 23:53:02,651: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:53:02.652091049Z [2024-02-22 23:53:02,651: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:53:02.652925096Z [2024-02-22 23:53:02,652: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:53:02.652962440Z [2024-02-22 23:53:02,652: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:53:02.830613905Z [2024-02-22 23:53:02,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:53:04.841674592Z [2024-02-22 23:53:04,841: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2a5f4ec-121a-4901-a1d8-840d8561b25f] succeeded in 4.619341471000098s: None 2024-02-22T23:53:05.001739177Z [2024-02-22 23:53:05,001: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8737d8e9-69b9-43d2-9d87-d2220705b47c] succeeded in 4.784359028000154s: None 2024-02-22T23:54:00.506557999Z [2024-02-22 23:54:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a8aadbe-63d7-42be-95ff-a6d5ecc3dc70] received 2024-02-22T23:54:00.510027533Z [2024-02-22 23:54:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b172ca2e-c0cb-4267-969a-7a7a952a7040] received 2024-02-22T23:54:00.516319600Z [2024-02-22 23:54:00,515: INFO/ForkPoolWorker-15] [9a8aadbe-63d7-42be-95ff-a6d5ecc3dc70] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:54:00.517362937Z [2024-02-22 23:54:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e94cb259-5dcc-4ea2-840e-ea2d5f1bc17c] received 2024-02-22T23:54:00.521863456Z [2024-02-22 23:54:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20a2fed3-9729-4773-975b-dbe7cf06657f] received 2024-02-22T23:54:00.526006589Z [2024-02-22 23:54:00,525: INFO/ForkPoolWorker-16] [b172ca2e-c0cb-4267-969a-7a7a952a7040] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:54:00.527037410Z [2024-02-22 23:54:00,526: INFO/ForkPoolWorker-1] [e94cb259-5dcc-4ea2-840e-ea2d5f1bc17c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:54:00.545864302Z [2024-02-22 23:54:00,545: INFO/ForkPoolWorker-2] [20a2fed3-9729-4773-975b-dbe7cf06657f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:54:00.888769806Z [2024-02-22 23:54:00,885: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:54:00.944372651Z [2024-02-22 23:54:00,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:54:01.017393320Z [2024-02-22 23:54:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:54:01.048698580Z [2024-02-22 23:54:01,041: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:54:01.072090311Z [2024-02-22 23:54:01,071: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-22T23:54:01.077665947Z [2024-02-22 23:54:01,077: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:54:01.130591132Z [2024-02-22 23:54:01,130: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:54:01.132621392Z [2024-02-22 23:54:01,132: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:54:01.132675514Z [2024-02-22 23:54:01,132: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:54:01.132799513Z [2024-02-22 23:54:01,132: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-22T23:54:01.133032774Z [2024-02-22 23:54:01,132: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:54:01.318456665Z [2024-02-22 23:54:01,318: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:54:01.664301599Z [2024-02-22 23:54:01,663: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:54:02.090477152Z [2024-02-22 23:54:02,090: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20a2fed3-9729-4773-975b-dbe7cf06657f] succeeded in 1.5649426039999526s: None 2024-02-22T23:54:02.294169758Z [2024-02-22 23:54:02,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a8aadbe-63d7-42be-95ff-a6d5ecc3dc70] succeeded in 1.7846619990000363s: None 2024-02-22T23:54:02.452947168Z [2024-02-22 23:54:02,452: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:54:02.456689488Z [2024-02-22 23:54:02,456: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:54:02.482549402Z [2024-02-22 23:54:02,482: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:54:02.484886568Z [2024-02-22 23:54:02,484: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:54:02.484931194Z [2024-02-22 23:54:02,484: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:54:02.485164832Z [2024-02-22 23:54:02,484: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:54:02.485462712Z [2024-02-22 23:54:02,485: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:54:02.485839409Z [2024-02-22 23:54:02,485: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:54:02.485931939Z [2024-02-22 23:54:02,485: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:54:02.582090122Z [2024-02-22 23:54:02,581: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:54:02.795238357Z [2024-02-22 23:54:02,794: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:54:02.799223132Z [2024-02-22 23:54:02,798: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:54:02.830306101Z [2024-02-22 23:54:02,829: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:54:02.832761829Z [2024-02-22 23:54:02,832: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:54:02.833021184Z [2024-02-22 23:54:02,832: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:54:02.833339728Z [2024-02-22 23:54:02,832: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:54:02.833562173Z [2024-02-22 23:54:02,833: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:54:02.834405292Z [2024-02-22 23:54:02,834: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:54:02.834701437Z [2024-02-22 23:54:02,834: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:54:02.930550338Z [2024-02-22 23:54:02,930: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:54:04.433137398Z [2024-02-22 23:54:04,432: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e94cb259-5dcc-4ea2-840e-ea2d5f1bc17c] succeeded in 3.9139423399999487s: None 2024-02-22T23:54:04.636890513Z [2024-02-22 23:54:04,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b172ca2e-c0cb-4267-969a-7a7a952a7040] succeeded in 4.124043450000045s: None 2024-02-22T23:55:01.064333026Z [2024-02-22 23:55:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9addf4f0-708c-4611-afcc-fc1fb619665d] received 2024-02-22T23:55:01.066132174Z [2024-02-22 23:55:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5c0b9c5-6246-49b3-bf08-0bfc724afc79] received 2024-02-22T23:55:01.079826209Z [2024-02-22 23:55:01,079: INFO/ForkPoolWorker-15] [9addf4f0-708c-4611-afcc-fc1fb619665d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:55:01.080242431Z [2024-02-22 23:55:01,080: INFO/ForkPoolWorker-16] [b5c0b9c5-6246-49b3-bf08-0bfc724afc79] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:55:01.096100557Z [2024-02-22 23:55:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db13df57-c5d1-4000-ac43-aa8bd4119f0d] received 2024-02-22T23:55:01.098929462Z [2024-02-22 23:55:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0893aa2c-7e68-4907-934a-8d4424fa7499] received 2024-02-22T23:55:01.110634870Z [2024-02-22 23:55:01,110: INFO/ForkPoolWorker-2] [0893aa2c-7e68-4907-934a-8d4424fa7499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:55:01.118550605Z [2024-02-22 23:55:01,118: INFO/ForkPoolWorker-1] [db13df57-c5d1-4000-ac43-aa8bd4119f0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:55:01.450800739Z [2024-02-22 23:55:01,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:55:01.515922156Z [2024-02-22 23:55:01,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:55:01.539205711Z [2024-02-22 23:55:01,533: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:55:01.715144264Z [2024-02-22 23:55:01,711: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:55:01.774749355Z [2024-02-22 23:55:01,774: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-22T23:55:01.779566576Z [2024-02-22 23:55:01,778: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:01.830279352Z [2024-02-22 23:55:01,830: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:55:01.833428324Z [2024-02-22 23:55:01,833: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:55:01.833836542Z [2024-02-22 23:55:01,833: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:55:01.834136945Z [2024-02-22 23:55:01,833: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-22T23:55:01.834989049Z [2024-02-22 23:55:01,834: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:55:01.920965229Z [2024-02-22 23:55:01,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:02.553833659Z [2024-02-22 23:55:02,553: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5c0b9c5-6246-49b3-bf08-0bfc724afc79] succeeded in 1.480325989999983s: None 2024-02-22T23:55:03.006462587Z [2024-02-22 23:55:03,006: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:55:03.010207005Z [2024-02-22 23:55:03,009: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:03.031485844Z [2024-02-22 23:55:03,031: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:55:03.035280729Z [2024-02-22 23:55:03,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:03.060556991Z [2024-02-22 23:55:03,060: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:55:03.064085120Z [2024-02-22 23:55:03,063: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:55:03.067554694Z [2024-02-22 23:55:03,064: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:55:03.067849776Z [2024-02-22 23:55:03,067: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:55:03.068069604Z [2024-02-22 23:55:03,067: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:55:03.071988529Z [2024-02-22 23:55:03,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:55:03.072249971Z [2024-02-22 23:55:03,071: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:55:03.091037348Z [2024-02-22 23:55:03,090: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:55:03.092929873Z [2024-02-22 23:55:03,092: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:55:03.093087285Z [2024-02-22 23:55:03,092: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:55:03.093241270Z [2024-02-22 23:55:03,093: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:55:03.093313009Z [2024-02-22 23:55:03,093: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:55:03.093667080Z [2024-02-22 23:55:03,093: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:55:03.093752876Z [2024-02-22 23:55:03,093: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:55:03.175522697Z [2024-02-22 23:55:03,175: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:55:03.179958212Z [2024-02-22 23:55:03,179: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:03.215596553Z [2024-02-22 23:55:03,215: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:55:03.220245221Z [2024-02-22 23:55:03,219: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:55:03.220319118Z [2024-02-22 23:55:03,220: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:55:03.220807562Z [2024-02-22 23:55:03,220: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:55:03.220815197Z [2024-02-22 23:55:03,220: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:55:03.220818776Z [2024-02-22 23:55:03,220: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:55:03.220822168Z [2024-02-22 23:55:03,220: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:55:03.232957807Z [2024-02-22 23:55:03,232: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:03.238488355Z [2024-02-22 23:55:03,237: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:03.330235681Z [2024-02-22 23:55:03,329: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:03.923132209Z [2024-02-22 23:55:03,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9addf4f0-708c-4611-afcc-fc1fb619665d] succeeded in 2.8505241510001724s: None 2024-02-22T23:55:04.058303068Z [2024-02-22 23:55:04,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[010a62bd-7fa1-4c5d-a611-43a30a72d027] received 2024-02-22T23:55:04.067280054Z [2024-02-22 23:55:04,066: INFO/ForkPoolWorker-15] [010a62bd-7fa1-4c5d-a611-43a30a72d027] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:55:04.400969675Z [2024-02-22 23:55:04,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:55:04.861190586Z [2024-02-22 23:55:04,859: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db13df57-c5d1-4000-ac43-aa8bd4119f0d] succeeded in 3.7597282740000537s: None 2024-02-22T23:55:05.597368212Z [2024-02-22 23:55:05,596: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0893aa2c-7e68-4907-934a-8d4424fa7499] succeeded in 4.496708144999957s: None 2024-02-22T23:55:05.805704428Z [2024-02-22 23:55:05,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:55:05.809469750Z [2024-02-22 23:55:05,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:05.828118681Z [2024-02-22 23:55:05,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:55:05.829556896Z [2024-02-22 23:55:05,829: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:55:05.829711315Z [2024-02-22 23:55:05,829: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:55:05.829989239Z [2024-02-22 23:55:05,829: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:55:05.830166814Z [2024-02-22 23:55:05,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:55:05.830677470Z [2024-02-22 23:55:05,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:55:05.830924609Z [2024-02-22 23:55:05,830: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:55:05.910392732Z [2024-02-22 23:55:05,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:06.514912035Z [2024-02-22 23:55:06,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[010a62bd-7fa1-4c5d-a611-43a30a72d027] succeeded in 2.4536611230000744s: None 2024-02-22T23:55:06.845711175Z [2024-02-22 23:55:06,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a89c540-aa46-4cc6-8761-e3b0df21fd74] received 2024-02-22T23:55:06.851402623Z [2024-02-22 23:55:06,851: INFO/ForkPoolWorker-15] [3a89c540-aa46-4cc6-8761-e3b0df21fd74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-22T23:55:07.133829864Z [2024-02-22 23:55:07,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:55:08.373098843Z [2024-02-22 23:55:08,372: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:55:08.376592902Z [2024-02-22 23:55:08,375: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:08.399891866Z [2024-02-22 23:55:08,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:55:08.401482747Z [2024-02-22 23:55:08,401: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:55:08.401506360Z [2024-02-22 23:55:08,401: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:55:08.401764744Z [2024-02-22 23:55:08,401: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:55:08.401794026Z [2024-02-22 23:55:08,401: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:55:08.402107863Z [2024-02-22 23:55:08,401: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:55:08.402119597Z [2024-02-22 23:55:08,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:55:08.498338045Z [2024-02-22 23:55:08,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:09.153016655Z [2024-02-22 23:55:09,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a89c540-aa46-4cc6-8761-e3b0df21fd74] succeeded in 2.305552913000156s: None 2024-02-22T23:55:09.213346639Z [2024-02-22 23:55:09,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3d5e0f4-004e-4bbc-b840-75784d842f1c] received 2024-02-22T23:55:09.220343008Z [2024-02-22 23:55:09,220: INFO/ForkPoolWorker-15] [f3d5e0f4-004e-4bbc-b840-75784d842f1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-22T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-22T23:55:09.503379272Z [2024-02-22 23:55:09,500: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-22T23:55:10.738626046Z [2024-02-22 23:55:10,738: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:55:10.742004310Z [2024-02-22 23:55:10,741: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:55:10.764447669Z [2024-02-22 23:55:10,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:55:10.765807572Z [2024-02-22 23:55:10,765: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:55:10.765826058Z [2024-02-22 23:55:10,765: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:55:10.765986567Z [2024-02-22 23:55:10,765: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:55:10.766006512Z [2024-02-22 23:55:10,765: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:55:10.766346122Z [2024-02-22 23:55:10,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-22T23:55:10.766434376Z [2024-02-22 23:55:10,766: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:55:10.877074177Z [2024-02-22 23:55:10,876: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:55:11.499229714Z [2024-02-22 23:55:11,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3d5e0f4-004e-4bbc-b840-75784d842f1c] succeeded in 2.283277675999898s: None 2024-02-22T23:56:01.107640334Z [2024-02-22 23:56:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3eba15ac-d420-4eb6-953f-df03a4e14788] received 2024-02-22T23:56:01.119078513Z [2024-02-22 23:56:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4077db8-bf6c-4acf-9951-9d966fa25c9d] received 2024-02-22T23:56:01.122086960Z [2024-02-22 23:56:01,121: INFO/ForkPoolWorker-15] [3eba15ac-d420-4eb6-953f-df03a4e14788] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:56:01.126423173Z [2024-02-22 23:56:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ee7c683-477f-4609-bee6-912909936e37] received 2024-02-22T23:56:01.135334786Z [2024-02-22 23:56:01,134: INFO/ForkPoolWorker-16] [c4077db8-bf6c-4acf-9951-9d966fa25c9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:56:01.146817655Z [2024-02-22 23:56:01,146: INFO/ForkPoolWorker-1] [2ee7c683-477f-4609-bee6-912909936e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:56:01.153900526Z [2024-02-22 23:56:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67dd7ed1-1ddc-42b8-b84a-4c594f440241] received 2024-02-22T23:56:01.161224394Z [2024-02-22 23:56:01,160: INFO/ForkPoolWorker-2] [67dd7ed1-1ddc-42b8-b84a-4c594f440241] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:56:01.562060176Z [2024-02-22 23:56:01,558: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:56:01.630184227Z [2024-02-22 23:56:01,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:56:01.694187957Z [2024-02-22 23:56:01,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:56:01.766040072Z [2024-02-22 23:56:01,765: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-22T23:56:01.771755746Z [2024-02-22 23:56:01,771: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:56:01.867430517Z [2024-02-22 23:56:01,867: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:56:01.873881987Z [2024-02-22 23:56:01,873: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:56:01.873951693Z [2024-02-22 23:56:01,873: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:56:01.873956675Z [2024-02-22 23:56:01,873: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-22T23:56:01.874141887Z [2024-02-22 23:56:01,874: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:56:01.938261174Z [2024-02-22 23:56:01,917: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:56:02.022421790Z [2024-02-22 23:56:02,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:56:02.051810388Z [2024-02-22 23:56:02,051: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:56:02.979174290Z [2024-02-22 23:56:02,978: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3eba15ac-d420-4eb6-953f-df03a4e14788] succeeded in 1.8693884920003256s: None 2024-02-22T23:56:02.991024735Z [2024-02-22 23:56:02,990: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67dd7ed1-1ddc-42b8-b84a-4c594f440241] succeeded in 1.835069262000161s: None 2024-02-22T23:56:03.334203016Z [2024-02-22 23:56:03,333: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:56:03.337548415Z [2024-02-22 23:56:03,337: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:56:03.375395318Z [2024-02-22 23:56:03,375: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:56:03.377355722Z [2024-02-22 23:56:03,377: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:56:03.377522453Z [2024-02-22 23:56:03,377: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:56:03.377783569Z [2024-02-22 23:56:03,377: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:56:03.378027900Z [2024-02-22 23:56:03,377: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:56:03.378429658Z [2024-02-22 23:56:03,378: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:56:03.378591509Z [2024-02-22 23:56:03,378: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:56:03.489874663Z [2024-02-22 23:56:03,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:56:03.763471864Z [2024-02-22 23:56:03,763: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:56:03.766654177Z [2024-02-22 23:56:03,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:56:03.785119223Z [2024-02-22 23:56:03,784: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:56:03.786350595Z [2024-02-22 23:56:03,786: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:56:03.786360050Z [2024-02-22 23:56:03,786: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:56:03.786531699Z [2024-02-22 23:56:03,786: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:56:03.786601616Z [2024-02-22 23:56:03,786: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:56:03.786919315Z [2024-02-22 23:56:03,786: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:56:03.786991909Z [2024-02-22 23:56:03,786: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:56:03.895397479Z [2024-02-22 23:56:03,895: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:56:05.235039567Z [2024-02-22 23:56:05,234: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4077db8-bf6c-4acf-9951-9d966fa25c9d] succeeded in 4.110079113000211s: None 2024-02-22T23:56:06.464520601Z [2024-02-22 23:56:06,463: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ee7c683-477f-4609-bee6-912909936e37] succeeded in 5.3323885509998945s: None 2024-02-22T23:57:01.022056534Z [2024-02-22 23:57:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4e94dd8-c6bc-4bff-9bad-9b30bb541dc9] received 2024-02-22T23:57:01.030602281Z [2024-02-22 23:57:01,030: INFO/ForkPoolWorker-15] [a4e94dd8-c6bc-4bff-9bad-9b30bb541dc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:57:01.036401247Z [2024-02-22 23:57:01,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b494cd4e-6f9b-4005-a226-8e283711b759] received 2024-02-22T23:57:01.041232372Z [2024-02-22 23:57:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3aaa9f1d-76e5-4008-a2a7-78c038b0fe81] received 2024-02-22T23:57:01.055407451Z [2024-02-22 23:57:01,052: INFO/ForkPoolWorker-16] [b494cd4e-6f9b-4005-a226-8e283711b759] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:57:01.057931175Z [2024-02-22 23:57:01,057: INFO/ForkPoolWorker-1] [3aaa9f1d-76e5-4008-a2a7-78c038b0fe81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:57:01.396250684Z [2024-02-22 23:57:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:57:01.398640968Z [2024-02-22 23:57:01,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:57:01.474272436Z [2024-02-22 23:57:01,471: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:57:01.554124028Z [2024-02-22 23:57:01,553: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-22T23:57:01.558179095Z [2024-02-22 23:57:01,557: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:57:01.583318314Z [2024-02-22 23:57:01,583: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:57:01.584685496Z [2024-02-22 23:57:01,584: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:57:01.584886624Z [2024-02-22 23:57:01,584: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:57:01.585042631Z [2024-02-22 23:57:01,584: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-22T23:57:01.585379619Z [2024-02-22 23:57:01,585: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:57:01.719648101Z [2024-02-22 23:57:01,719: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:57:02.319125699Z [2024-02-22 23:57:02,318: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b494cd4e-6f9b-4005-a226-8e283711b759] succeeded in 1.2806199540000307s: None 2024-02-22T23:57:02.572498304Z [2024-02-22 23:57:02,572: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-22T23:57:02.576101198Z [2024-02-22 23:57:02,575: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:57:02.602888143Z [2024-02-22 23:57:02,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:57:02.604339144Z [2024-02-22 23:57:02,604: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:57:02.604454294Z [2024-02-22 23:57:02,604: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:57:02.604642450Z [2024-02-22 23:57:02,604: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:57:02.604717512Z [2024-02-22 23:57:02,604: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-22T23:57:02.604997474Z [2024-02-22 23:57:02,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:57:02.605114253Z [2024-02-22 23:57:02,605: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:57:02.684787509Z [2024-02-22 23:57:02,684: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:57:02.686681412Z [2024-02-22 23:57:02,686: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:57:02.690202136Z [2024-02-22 23:57:02,689: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:57:02.712813205Z [2024-02-22 23:57:02,712: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:57:02.714216898Z [2024-02-22 23:57:02,713: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:57:02.714238975Z [2024-02-22 23:57:02,714: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:57:02.714417671Z [2024-02-22 23:57:02,714: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:57:02.714447369Z [2024-02-22 23:57:02,714: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:57:02.714923650Z [2024-02-22 23:57:02,714: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:57:02.715299287Z [2024-02-22 23:57:02,715: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:57:02.817634545Z [2024-02-22 23:57:02,817: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:57:04.831949602Z [2024-02-22 23:57:04,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4e94dd8-c6bc-4bff-9bad-9b30bb541dc9] succeeded in 3.807690287999776s: None 2024-02-22T23:57:05.517387153Z [2024-02-22 23:57:05,517: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3aaa9f1d-76e5-4008-a2a7-78c038b0fe81] succeeded in 4.469027144999927s: None 2024-02-22T23:58:00.944083149Z [2024-02-22 23:58:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6210229-63e2-4225-958d-a0b8237b1b96] received 2024-02-22T23:58:00.950865860Z [2024-02-22 23:58:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cccf35f-53ca-4174-8390-a867015a917f] received 2024-02-22T23:58:00.959085455Z [2024-02-22 23:58:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38e8fecb-b29e-4aee-a37d-571b8a85dbb9] received 2024-02-22T23:58:00.964096938Z [2024-02-22 23:58:00,963: INFO/ForkPoolWorker-16] [3cccf35f-53ca-4174-8390-a867015a917f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:58:00.965253536Z [2024-02-22 23:58:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a3687e9-edb4-4a90-a445-b53b403ebfed] received 2024-02-22T23:58:00.966020802Z [2024-02-22 23:58:00,965: INFO/ForkPoolWorker-1] [38e8fecb-b29e-4aee-a37d-571b8a85dbb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:58:00.983185397Z [2024-02-22 23:58:00,969: INFO/ForkPoolWorker-15] [a6210229-63e2-4225-958d-a0b8237b1b96] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-22T23:58:00.987939111Z [2024-02-22 23:58:00,987: INFO/ForkPoolWorker-2] [9a3687e9-edb4-4a90-a445-b53b403ebfed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:58:01.296246840Z [2024-02-22 23:58:01,292: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-22T23:58:01.296573554Z [2024-02-22 23:58:01,284: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:58:01.307021576Z [2024-02-22 23:58:01,303: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:58:01.473727672Z [2024-02-22 23:58:01,468: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:58:01.647920397Z [2024-02-22 23:58:01,647: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:58:01.768455578Z [2024-02-22 23:58:01,767: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-22T23:58:01.776022561Z [2024-02-22 23:58:01,775: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:58:01.819575424Z [2024-02-22 23:58:01,819: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:58:01.821938051Z [2024-02-22 23:58:01,821: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:58:01.823737843Z [2024-02-22 23:58:01,823: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:58:01.823994403Z [2024-02-22 23:58:01,823: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-22T23:58:01.824584153Z [2024-02-22 23:58:01,824: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:58:01.972765217Z [2024-02-22 23:58:01,972: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:58:02.307914277Z [2024-02-22 23:58:02,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6210229-63e2-4225-958d-a0b8237b1b96] succeeded in 1.3580873820001216s: None 2024-02-22T23:58:02.557029821Z [2024-02-22 23:58:02,556: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[38e8fecb-b29e-4aee-a37d-571b8a85dbb9] succeeded in 1.5964002149999033s: None 2024-02-22T23:58:02.736621182Z [2024-02-22 23:58:02,736: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:58:02.740431940Z [2024-02-22 23:58:02,739: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:58:02.773231323Z [2024-02-22 23:58:02,773: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:58:02.774958854Z [2024-02-22 23:58:02,774: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:58:02.775090719Z [2024-02-22 23:58:02,774: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:58:02.775274642Z [2024-02-22 23:58:02,775: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:58:02.775402824Z [2024-02-22 23:58:02,775: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:58:02.775661857Z [2024-02-22 23:58:02,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:58:02.775873598Z [2024-02-22 23:58:02,775: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:58:02.821527850Z [2024-02-22 23:58:02,821: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-22T23:58:02.824877277Z [2024-02-22 23:58:02,824: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:58:02.844781739Z [2024-02-22 23:58:02,844: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-22T23:58:02.846053224Z [2024-02-22 23:58:02,845: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:58:02.846062622Z [2024-02-22 23:58:02,845: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:58:02.846210857Z [2024-02-22 23:58:02,846: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:58:02.846313966Z [2024-02-22 23:58:02,846: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-22T23:58:02.846582962Z [2024-02-22 23:58:02,846: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:58:02.846597913Z [2024-02-22 23:58:02,846: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:58:02.863575310Z [2024-02-22 23:58:02,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:58:02.956150063Z [2024-02-22 23:58:02,955: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:58:04.405670572Z [2024-02-22 23:58:04,404: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a3687e9-edb4-4a90-a445-b53b403ebfed] succeeded in 3.4267228440003237s: None 2024-02-22T23:58:04.805142126Z [2024-02-22 23:58:04,804: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3cccf35f-53ca-4174-8390-a867015a917f] succeeded in 3.8516198709999117s: None 2024-02-22T23:59:00.911631524Z [2024-02-22 23:59:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b993ace-3e21-4d65-98d7-69ddb4de8577] received 2024-02-22T23:59:00.913607906Z [2024-02-22 23:59:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0caed578-21ea-4ef8-8a9a-7fd27aed13a5] received 2024-02-22T23:59:00.920289588Z [2024-02-22 23:59:00,919: INFO/ForkPoolWorker-15] [4b993ace-3e21-4d65-98d7-69ddb4de8577] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-22T23:59:00.923211534Z [2024-02-22 23:59:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb29e53d-019e-4bb1-b004-36974347bc21] received 2024-02-22T23:59:00.923403484Z [2024-02-22 23:59:00,923: INFO/ForkPoolWorker-16] [0caed578-21ea-4ef8-8a9a-7fd27aed13a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-22T23:59:00.935566906Z [2024-02-22 23:59:00,935: INFO/ForkPoolWorker-1] [eb29e53d-019e-4bb1-b004-36974347bc21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-22T23:59:01.250029753Z [2024-02-22 23:59:01,246: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-22T23:59:01.250146899Z [2024-02-22 23:59:01,246: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-22T23:59:01.345575299Z [2024-02-22 23:59:01,341: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-22T23:59:01.425270118Z [2024-02-22 23:59:01,424: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-22T23:59:01.431289981Z [2024-02-22 23:59:01,430: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:59:01.452880529Z [2024-02-22 23:59:01,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-22T23:59:01.455389734Z [2024-02-22 23:59:01,455: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-22T23:59:01.455475093Z [2024-02-22 23:59:01,455: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-22T23:59:01.456076584Z [2024-02-22 23:59:01,455: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-22T23:59:01.456347352Z [2024-02-22 23:59:01,456: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-22T23:59:01.565731059Z [2024-02-22 23:59:01,565: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:59:02.198633460Z [2024-02-22 23:59:02,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b993ace-3e21-4d65-98d7-69ddb4de8577] succeeded in 1.2838612609998563s: None 2024-02-22T23:59:02.463639301Z [2024-02-22 23:59:02,463: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-22T23:59:02.467536890Z [2024-02-22 23:59:02,467: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:59:02.493957231Z [2024-02-22 23:59:02,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-22T23:59:02.495499769Z [2024-02-22 23:59:02,495: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:59:02.495634746Z [2024-02-22 23:59:02,495: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:59:02.495965118Z [2024-02-22 23:59:02,495: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:59:02.496106503Z [2024-02-22 23:59:02,495: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-22T23:59:02.496465376Z [2024-02-22 23:59:02,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-22T23:59:02.496653776Z [2024-02-22 23:59:02,496: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:59:02.600338189Z [2024-02-22 23:59:02,599: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:59:02.731217411Z [2024-02-22 23:59:02,730: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-22T23:59:02.734817639Z [2024-02-22 23:59:02,734: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-22T23:59:02.766928838Z [2024-02-22 23:59:02,766: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-22T23:59:02.768694719Z [2024-02-22 23:59:02,768: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-22T23:59:02.768706263Z [2024-02-22 23:59:02,768: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-22T23:59:02.768944403Z [2024-02-22 23:59:02,768: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-22T23:59:02.769046497Z [2024-02-22 23:59:02,768: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-22T23:59:02.769408174Z [2024-02-22 23:59:02,769: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-22T23:59:02.769501904Z [2024-02-22 23:59:02,769: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-22T23:59:02.868464987Z [2024-02-22 23:59:02,868: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-22T23:59:04.486725314Z [2024-02-22 23:59:04,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0caed578-21ea-4ef8-8a9a-7fd27aed13a5] succeeded in 3.5690029769998546s: None 2024-02-22T23:59:04.680178447Z [2024-02-22 23:59:04,679: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb29e53d-019e-4bb1-b004-36974347bc21] succeeded in 3.754632908000076s: None 2024-02-23T00:00:00.263563084Z [2024-02-23 00:00:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4410a9c4-2c59-4327-bc64-f03bdf6804c6] received 2024-02-23T00:00:00.272196630Z [2024-02-23 00:00:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19e49edb-7aa1-4a87-a353-d1c42cd33624] received 2024-02-23T00:00:00.273105101Z [2024-02-23 00:00:00,272: INFO/ForkPoolWorker-15] [4410a9c4-2c59-4327-bc64-f03bdf6804c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:00:00.279368180Z [2024-02-23 00:00:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96a22a85-837a-462e-8cd8-6e1774008e8d] received 2024-02-23T00:00:00.284510561Z [2024-02-23 00:00:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a0e04ae-94d2-4285-a57e-89ccd57448f0] received 2024-02-23T00:00:00.288326482Z [2024-02-23 00:00:00,287: INFO/ForkPoolWorker-16] [19e49edb-7aa1-4a87-a353-d1c42cd33624] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:00:00.289114014Z [2024-02-23 00:00:00,288: INFO/ForkPoolWorker-1] [96a22a85-837a-462e-8cd8-6e1774008e8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:00:00.292503157Z [2024-02-23 00:00:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86d5304a-515b-49d3-9d76-462574d648b7] received 2024-02-23T00:00:00.293316017Z [2024-02-23 00:00:00,293: INFO/ForkPoolWorker-2] [5a0e04ae-94d2-4285-a57e-89ccd57448f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-22T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:00:00.316294157Z [2024-02-23 00:00:00,315: INFO/ForkPoolWorker-3] [86d5304a-515b-49d3-9d76-462574d648b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:00:00.622775946Z [2024-02-23 00:00:00,619: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:00:00.726651562Z [2024-02-23 00:00:00,723: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:00:00.846614327Z [2024-02-23 00:00:00,843: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:00.879437517Z [2024-02-23 00:00:00,876: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:00:00.962260205Z [2024-02-23 00:00:00,958: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:00:01.175373102Z [2024-02-23 00:00:01,175: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:01.248657620Z [2024-02-23 00:00:01,248: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:00:01.253240395Z [2024-02-23 00:00:01,252: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:01.328096165Z [2024-02-23 00:00:01,327: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:00:01.329506505Z [2024-02-23 00:00:01,329: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:00:01.329660069Z [2024-02-23 00:00:01,329: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:00:01.329778433Z [2024-02-23 00:00:01,329: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:00:01.330061543Z [2024-02-23 00:00:01,329: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:00:01.514848591Z [2024-02-23 00:00:01,514: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:01.764989537Z [2024-02-23 00:00:01,764: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a0e04ae-94d2-4285-a57e-89ccd57448f0] succeeded in 1.4793183589999899s: None 2024-02-23T00:00:02.188377929Z [2024-02-23 00:00:02,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96a22a85-837a-462e-8cd8-6e1774008e8d] succeeded in 1.907321029999821s: None 2024-02-23T00:00:02.190495146Z [2024-02-23 00:00:02,190: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:00:02.195104848Z [2024-02-23 00:00:02,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:02.229813796Z [2024-02-23 00:00:02,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:00:02.231308981Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:02.231381604Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:02.231395684Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:02.231497114Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:02.231523970Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:00:02.231911861Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:00:02.231942422Z [2024-02-23 00:00:02,231: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:02.237141555Z [2024-02-23 00:00:02,236: INFO/ForkPoolWorker-16] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:02.331606524Z [2024-02-23 00:00:02,331: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:02.420203500Z [2024-02-23 00:00:02,419: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:00:02.423915785Z [2024-02-23 00:00:02,423: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:02.453126739Z [2024-02-23 00:00:02,452: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:00:02.454945710Z [2024-02-23 00:00:02,454: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:02.455349174Z [2024-02-23 00:00:02,455: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:02.455535797Z [2024-02-23 00:00:02,455: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:02.455793719Z [2024-02-23 00:00:02,455: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:02.456000129Z [2024-02-23 00:00:02,455: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:00:02.456410776Z [2024-02-23 00:00:02,456: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:00:02.457018331Z [2024-02-23 00:00:02,456: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:02.462995298Z [2024-02-23 00:00:02,462: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:02.560600319Z [2024-02-23 00:00:02,560: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:02.624265209Z [2024-02-23 00:00:02,623: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:02.628065162Z [2024-02-23 00:00:02,627: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:02.652130865Z [2024-02-23 00:00:02,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:02.654449252Z [2024-02-23 00:00:02,654: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:02.654506985Z [2024-02-23 00:00:02,654: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:02.654512117Z [2024-02-23 00:00:02,654: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:02.654652527Z [2024-02-23 00:00:02,654: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:02.654679349Z [2024-02-23 00:00:02,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:02.655378005Z [2024-02-23 00:00:02,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:02.655393439Z [2024-02-23 00:00:02,655: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:02.662355485Z [2024-02-23 00:00:02,662: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:02.762450728Z [2024-02-23 00:00:02,762: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:03.477541690Z [2024-02-23 00:00:03,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4410a9c4-2c59-4327-bc64-f03bdf6804c6] succeeded in 3.211370984000041s: None 2024-02-23T00:00:03.867529206Z [2024-02-23 00:00:03,866: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19e49edb-7aa1-4a87-a353-d1c42cd33624] succeeded in 3.5866182709996792s: None 2024-02-23T00:00:03.939276276Z [2024-02-23 00:00:03,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94947678-50fc-486b-9606-001c6fcb95d2] received 2024-02-23T00:00:03.949407165Z [2024-02-23 00:00:03,949: INFO/ForkPoolWorker-15] [94947678-50fc-486b-9606-001c6fcb95d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:00:04.239336743Z [2024-02-23 00:00:04,235: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:04.450146756Z [2024-02-23 00:00:04,449: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[86d5304a-515b-49d3-9d76-462574d648b7] succeeded in 4.150579472000118s: None 2024-02-23T00:00:05.544470067Z [2024-02-23 00:00:05,544: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:05.547917935Z [2024-02-23 00:00:05,547: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:05.572587029Z [2024-02-23 00:00:05,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:05.574296976Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:05.574322415Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:05.574389393Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:05.574588585Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:05.574598935Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:05.574959835Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:05.574976319Z [2024-02-23 00:00:05,574: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:05.582284297Z [2024-02-23 00:00:05,581: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:05.687650428Z [2024-02-23 00:00:05,687: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:06.390649626Z [2024-02-23 00:00:06,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94947678-50fc-486b-9606-001c6fcb95d2] succeeded in 2.44543604699993s: None 2024-02-23T00:00:06.771918943Z [2024-02-23 00:00:06,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11f9f587-d9b5-4c54-ac64-7ec14cc59cfe] received 2024-02-23T00:00:06.782892066Z [2024-02-23 00:00:06,782: INFO/ForkPoolWorker-15] [11f9f587-d9b5-4c54-ac64-7ec14cc59cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:00:07.121283187Z [2024-02-23 00:00:07,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:08.377021821Z [2024-02-23 00:00:08,376: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:08.380424976Z [2024-02-23 00:00:08,379: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:08.407280850Z [2024-02-23 00:00:08,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:08.408793660Z [2024-02-23 00:00:08,408: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:08.408851845Z [2024-02-23 00:00:08,408: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:08.408856733Z [2024-02-23 00:00:08,408: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:08.409015142Z [2024-02-23 00:00:08,408: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:08.409068172Z [2024-02-23 00:00:08,408: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:08.409329048Z [2024-02-23 00:00:08,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:08.409394008Z [2024-02-23 00:00:08,409: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:08.421824012Z [2024-02-23 00:00:08,421: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:08.509542883Z [2024-02-23 00:00:08,509: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:09.017491148Z [2024-02-23 00:00:09,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11f9f587-d9b5-4c54-ac64-7ec14cc59cfe] succeeded in 2.242586043999836s: None 2024-02-23T00:00:09.350659726Z [2024-02-23 00:00:09,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f29a8fdc-d1ab-42bf-b265-b7dba7e7a872] received 2024-02-23T00:00:09.363196625Z [2024-02-23 00:00:09,362: INFO/ForkPoolWorker-15] [f29a8fdc-d1ab-42bf-b265-b7dba7e7a872] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:00:09.639762405Z [2024-02-23 00:00:09,636: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:10.902495184Z [2024-02-23 00:00:10,902: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:10.905888530Z [2024-02-23 00:00:10,905: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:10.924032368Z [2024-02-23 00:00:10,923: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:10.925601905Z [2024-02-23 00:00:10,925: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:10.925627993Z [2024-02-23 00:00:10,925: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:10.925635292Z [2024-02-23 00:00:10,925: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:10.925803244Z [2024-02-23 00:00:10,925: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:10.925907011Z [2024-02-23 00:00:10,925: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:10.926254210Z [2024-02-23 00:00:10,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:10.926452290Z [2024-02-23 00:00:10,926: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:10.932640637Z [2024-02-23 00:00:10,932: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:11.023884715Z [2024-02-23 00:00:11,023: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:11.632593237Z [2024-02-23 00:00:11,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f29a8fdc-d1ab-42bf-b265-b7dba7e7a872] succeeded in 2.279676055999971s: None 2024-02-23T00:00:15.243729864Z [2024-02-23 00:00:15,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34ae9ff3-c80d-4d98-a7c9-8b1eafcbbdf7] received 2024-02-23T00:00:15.245626191Z [2024-02-23 00:00:15,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac82faae-34a0-4533-86a3-3b957ea205b6] received 2024-02-23T00:00:15.263503854Z [2024-02-23 00:00:15,263: INFO/ForkPoolWorker-16] [ac82faae-34a0-4533-86a3-3b957ea205b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:00:15.269334608Z [2024-02-23 00:00:15,269: INFO/ForkPoolWorker-15] [34ae9ff3-c80d-4d98-a7c9-8b1eafcbbdf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-22T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:00:15.642799428Z [2024-02-23 00:00:15,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:00:15.667325211Z [2024-02-23 00:00:15,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:00:16.784302432Z [2024-02-23 00:00:16,783: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:16.787610355Z [2024-02-23 00:00:16,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:16.807426798Z [2024-02-23 00:00:16,807: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:16.808818275Z [2024-02-23 00:00:16,808: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:16.808827027Z [2024-02-23 00:00:16,808: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:16.808947944Z [2024-02-23 00:00:16,808: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:16.809142293Z [2024-02-23 00:00:16,808: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:16.809154770Z [2024-02-23 00:00:16,809: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:16.809605004Z [2024-02-23 00:00:16,809: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:00:16.809616805Z [2024-02-23 00:00:16,809: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:16.814369434Z [2024-02-23 00:00:16,814: INFO/ForkPoolWorker-15] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:16.887699635Z [2024-02-23 00:00:16,887: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:16.906020748Z [2024-02-23 00:00:16,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:00:16.909248666Z [2024-02-23 00:00:16,908: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:16.928528373Z [2024-02-23 00:00:16,928: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:00:16.929625389Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:16.929644590Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:16.929661482Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:16.929786878Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:16.929831715Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:00:16.930004754Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:00:16.930024086Z [2024-02-23 00:00:16,929: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:16.934560626Z [2024-02-23 00:00:16,934: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:17.012952598Z [2024-02-23 00:00:17,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:17.358069423Z [2024-02-23 00:00:17,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50f30c20-3dfe-431b-8d33-2687824851f0] received 2024-02-23T00:00:17.366325881Z [2024-02-23 00:00:17,366: INFO/ForkPoolWorker-1] [50f30c20-3dfe-431b-8d33-2687824851f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:00:17.666395383Z [2024-02-23 00:00:17,663: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:18.333643623Z [2024-02-23 00:00:18,333: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34ae9ff3-c80d-4d98-a7c9-8b1eafcbbdf7] succeeded in 3.0885327289997804s: None 2024-02-23T00:00:18.816399895Z [2024-02-23 00:00:18,815: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:00:18.819553820Z [2024-02-23 00:00:18,819: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:18.839707695Z [2024-02-23 00:00:18,839: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:00:18.841363869Z [2024-02-23 00:00:18,841: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:18.841385954Z [2024-02-23 00:00:18,841: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:18.841420878Z [2024-02-23 00:00:18,841: INFO/ForkPoolWorker-1] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:18.841746649Z [2024-02-23 00:00:18,841: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:18.841871393Z [2024-02-23 00:00:18,841: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:00:18.842315854Z [2024-02-23 00:00:18,842: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:18.842570401Z [2024-02-23 00:00:18,842: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:18.849513389Z [2024-02-23 00:00:18,849: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:18.912987784Z [2024-02-23 00:00:18,912: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:19.141839935Z [2024-02-23 00:00:19,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac82faae-34a0-4533-86a3-3b957ea205b6] succeeded in 3.8864636280000013s: None 2024-02-23T00:00:19.459507495Z [2024-02-23 00:00:19,459: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50f30c20-3dfe-431b-8d33-2687824851f0] succeeded in 2.0983048029997917s: None 2024-02-23T00:00:19.734146151Z [2024-02-23 00:00:19,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61e86ecc-b790-4698-bc0d-cf0bfbd123e9] received 2024-02-23T00:00:19.750119493Z [2024-02-23 00:00:19,749: INFO/ForkPoolWorker-15] [61e86ecc-b790-4698-bc0d-cf0bfbd123e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'split_metrics', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:00:20.034082218Z [2024-02-23 00:00:20,031: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:21.164673687Z [2024-02-23 00:00:21,164: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:21.167816358Z [2024-02-23 00:00:21,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:21.185525514Z [2024-02-23 00:00:21,185: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:21.186877031Z [2024-02-23 00:00:21,186: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:21.186898592Z [2024-02-23 00:00:21,186: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:21.186963974Z [2024-02-23 00:00:21,186: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:21.187083914Z [2024-02-23 00:00:21,186: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:21.187110204Z [2024-02-23 00:00:21,187: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:21.187356396Z [2024-02-23 00:00:21,187: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:21.187404670Z [2024-02-23 00:00:21,187: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:21.193127312Z [2024-02-23 00:00:21,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:21.265135235Z [2024-02-23 00:00:21,264: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:21.815810706Z [2024-02-23 00:00:21,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fa22cb5-5b97-45fb-bdc0-72a5d28557f3] received 2024-02-23T00:00:21.824509522Z [2024-02-23 00:00:21,824: INFO/ForkPoolWorker-16] [3fa22cb5-5b97-45fb-bdc0-72a5d28557f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'collect_metrics', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:00:21.857027179Z [2024-02-23 00:00:21,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61e86ecc-b790-4698-bc0d-cf0bfbd123e9] succeeded in 2.1211790110000948s: None 2024-02-23T00:00:22.119890424Z [2024-02-23 00:00:22,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:23.205123947Z [2024-02-23 00:00:23,204: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:00:23.208448252Z [2024-02-23 00:00:23,207: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:23.231352416Z [2024-02-23 00:00:23,231: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:00:23.232670189Z [2024-02-23 00:00:23,232: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:23.232702719Z [2024-02-23 00:00:23,232: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:23.232787511Z [2024-02-23 00:00:23,232: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:23.232966634Z [2024-02-23 00:00:23,232: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:23.232984408Z [2024-02-23 00:00:23,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:00:23.233324539Z [2024-02-23 00:00:23,233: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:23.233338388Z [2024-02-23 00:00:23,233: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:23.240298874Z [2024-02-23 00:00:23,240: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:23.323377549Z [2024-02-23 00:00:23,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:23.923918059Z [2024-02-23 00:00:23,923: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fa22cb5-5b97-45fb-bdc0-72a5d28557f3] succeeded in 2.105683244999909s: None 2024-02-23T00:00:24.179250732Z [2024-02-23 00:00:24,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0a9ac4c-7b4b-4a0d-8467-890839d6b072] received 2024-02-23T00:00:24.190368959Z [2024-02-23 00:00:24,190: INFO/ForkPoolWorker-15] [b0a9ac4c-7b4b-4a0d-8467-890839d6b072] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'send_prometheus', 'scheduled__2024-02-22T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:00:24.462797979Z [2024-02-23 00:00:24,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:00:25.608116144Z [2024-02-23 00:00:25,607: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:00:25.611646149Z [2024-02-23 00:00:25,611: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:00:25.631075751Z [2024-02-23 00:00:25,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:00:25.633065597Z [2024-02-23 00:00:25,632: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:00:25.633198112Z [2024-02-23 00:00:25,633: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:00:25.633334624Z [2024-02-23 00:00:25,633: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:00:25.633537349Z [2024-02-23 00:00:25,633: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:00:25.633642833Z [2024-02-23 00:00:25,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:00:25.633985173Z [2024-02-23 00:00:25,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:00:25.634143920Z [2024-02-23 00:00:25,634: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:00:25.640459487Z [2024-02-23 00:00:25,640: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:00:25.715293460Z [2024-02-23 00:00:25,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:00:26.255102991Z [2024-02-23 00:00:26,254: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0a9ac4c-7b4b-4a0d-8467-890839d6b072] succeeded in 2.0728081409997685s: None 2024-02-23T00:01:00.403356057Z [2024-02-23 00:01:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01dd6aef-ef87-4c82-9582-0e107583dc44] received 2024-02-23T00:01:00.405462395Z [2024-02-23 00:01:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0506aee-9694-438f-916e-c4bdd57cb1f4] received 2024-02-23T00:01:00.410688059Z [2024-02-23 00:01:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c88f8be-a68b-4ebb-8299-776373080bba] received 2024-02-23T00:01:00.411882577Z [2024-02-23 00:01:00,411: INFO/ForkPoolWorker-15] [01dd6aef-ef87-4c82-9582-0e107583dc44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:01:00.419642168Z [2024-02-23 00:01:00,419: INFO/ForkPoolWorker-1] [3c88f8be-a68b-4ebb-8299-776373080bba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:01:00.420987769Z [2024-02-23 00:01:00,420: INFO/ForkPoolWorker-16] [f0506aee-9694-438f-916e-c4bdd57cb1f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:01:00.426638681Z [2024-02-23 00:01:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce6896c6-40f5-4df2-bfc6-5c07a7656714] received 2024-02-23T00:01:00.440108401Z [2024-02-23 00:01:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[234a9afb-a452-4a5c-940e-639f1daee400] received 2024-02-23T00:01:00.443548858Z [2024-02-23 00:01:00,443: INFO/ForkPoolWorker-2] [ce6896c6-40f5-4df2-bfc6-5c07a7656714] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:01:00.449231714Z [2024-02-23 00:01:00,448: INFO/ForkPoolWorker-3] [234a9afb-a452-4a5c-940e-639f1daee400] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:01:00.749685880Z [2024-02-23 00:01:00,743: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:01:00.847545540Z [2024-02-23 00:01:00,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:01:01.010456689Z [2024-02-23 00:01:01,007: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:01:01.044341965Z [2024-02-23 00:01:01,041: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:01:01.110117788Z [2024-02-23 00:01:01,107: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:01:01.141498071Z [2024-02-23 00:01:01,141: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:01:01.145942767Z [2024-02-23 00:01:01,145: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:01:01.180174106Z [2024-02-23 00:01:01,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:01:01.183910228Z [2024-02-23 00:01:01,183: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:01:01.183970957Z [2024-02-23 00:01:01,183: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:01:01.183975805Z [2024-02-23 00:01:01,183: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:01:01.184187201Z [2024-02-23 00:01:01,184: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:01:01.324537740Z [2024-02-23 00:01:01,324: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:01:02.081538934Z [2024-02-23 00:01:02,081: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0506aee-9694-438f-916e-c4bdd57cb1f4] succeeded in 1.674558799999886s: None 2024-02-23T00:01:02.414614520Z [2024-02-23 00:01:02,414: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:01:02.419015926Z [2024-02-23 00:01:02,418: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:01:02.455637100Z [2024-02-23 00:01:02,455: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:01:02.459921109Z [2024-02-23 00:01:02,459: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:01:02.460116806Z [2024-02-23 00:01:02,459: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:01:02.460323092Z [2024-02-23 00:01:02,460: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:01:02.460624450Z [2024-02-23 00:01:02,460: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:01:02.460862431Z [2024-02-23 00:01:02,460: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:01:02.461306996Z [2024-02-23 00:01:02,461: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:01:02.461624480Z [2024-02-23 00:01:02,461: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:01:02.467364324Z [2024-02-23 00:01:02,467: INFO/ForkPoolWorker-3] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:01:02.579092661Z [2024-02-23 00:01:02,578: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:01:02.612536953Z [2024-02-23 00:01:02,612: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:01:02.630294681Z [2024-02-23 00:01:02,629: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:01:02.679350771Z [2024-02-23 00:01:02,674: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:01:02.682019801Z [2024-02-23 00:01:02,681: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:01:02.682288953Z [2024-02-23 00:01:02,682: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:01:02.682431287Z [2024-02-23 00:01:02,682: INFO/ForkPoolWorker-1] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:01:02.682665958Z [2024-02-23 00:01:02,682: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:01:02.682870317Z [2024-02-23 00:01:02,682: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:01:02.683365859Z [2024-02-23 00:01:02,683: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:01:02.684096728Z [2024-02-23 00:01:02,683: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:01:02.689422018Z [2024-02-23 00:01:02,689: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:01:02.698860762Z [2024-02-23 00:01:02,698: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:01:02.703815068Z [2024-02-23 00:01:02,703: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:01:02.725111579Z [2024-02-23 00:01:02,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:01:02.729529773Z [2024-02-23 00:01:02,728: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:01:02.733040934Z [2024-02-23 00:01:02,732: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:01:02.741260827Z [2024-02-23 00:01:02,740: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:01:02.741555322Z [2024-02-23 00:01:02,741: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:01:02.741852291Z [2024-02-23 00:01:02,741: INFO/ForkPoolWorker-2] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:01:02.742066416Z [2024-02-23 00:01:02,741: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:01:02.742093063Z [2024-02-23 00:01:02,742: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:01:02.742469253Z [2024-02-23 00:01:02,742: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:01:02.742537046Z [2024-02-23 00:01:02,742: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:01:02.748061321Z [2024-02-23 00:01:02,747: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:01:02.762047905Z [2024-02-23 00:01:02,761: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:01:02.764180583Z [2024-02-23 00:01:02,763: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:01:02.764370542Z [2024-02-23 00:01:02,764: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:01:02.764661518Z [2024-02-23 00:01:02,764: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:01:02.764741202Z [2024-02-23 00:01:02,764: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:01:02.764754360Z [2024-02-23 00:01:02,764: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:01:02.765783010Z [2024-02-23 00:01:02,765: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:01:02.765996176Z [2024-02-23 00:01:02,765: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:01:02.771197530Z [2024-02-23 00:01:02,770: INFO/ForkPoolWorker-15] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:01:02.878025878Z [2024-02-23 00:01:02,877: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:01:02.879652389Z [2024-02-23 00:01:02,879: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:01:02.934485925Z [2024-02-23 00:01:02,934: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:01:05.100811159Z [2024-02-23 00:01:05,100: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[234a9afb-a452-4a5c-940e-639f1daee400] succeeded in 4.659277788000054s: None 2024-02-23T00:01:05.575236760Z [2024-02-23 00:01:05,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01dd6aef-ef87-4c82-9582-0e107583dc44] succeeded in 5.168579963999946s: None 2024-02-23T00:01:05.741952485Z [2024-02-23 00:01:05,741: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ce6896c6-40f5-4df2-bfc6-5c07a7656714] succeeded in 5.3097095490002175s: None 2024-02-23T00:01:06.349904132Z [2024-02-23 00:01:06,349: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c88f8be-a68b-4ebb-8299-776373080bba] succeeded in 5.937297194999701s: None 2024-02-23T00:02:01.296879945Z [2024-02-23 00:02:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d5610e0-f78f-4a74-bdde-ee0e82e824b4] received 2024-02-23T00:02:01.298982825Z [2024-02-23 00:02:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d3db8ec-0cde-47bd-98a7-68622c3ea0eb] received 2024-02-23T00:02:01.304474979Z [2024-02-23 00:02:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04347600-1129-46ad-8b2b-9238adddc825] received 2024-02-23T00:02:01.307784200Z [2024-02-23 00:02:01,307: INFO/ForkPoolWorker-16] [2d3db8ec-0cde-47bd-98a7-68622c3ea0eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:02:01.308329257Z [2024-02-23 00:02:01,308: INFO/ForkPoolWorker-15] [8d5610e0-f78f-4a74-bdde-ee0e82e824b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:02:01.315178667Z [2024-02-23 00:02:01,314: INFO/ForkPoolWorker-1] [04347600-1129-46ad-8b2b-9238adddc825] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:02:01.327729720Z [2024-02-23 00:02:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6168919-9217-400e-a064-eff48a303ff5] received 2024-02-23T00:02:01.333360005Z [2024-02-23 00:02:01,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19634869-7b89-4840-b219-213a408e1f81] received 2024-02-23T00:02:01.338247413Z [2024-02-23 00:02:01,337: INFO/ForkPoolWorker-2] [e6168919-9217-400e-a064-eff48a303ff5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:02:01.340686659Z [2024-02-23 00:02:01,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c0c0d39-e929-4603-a0cf-8356aa2e6a1e] received 2024-02-23T00:02:01.347296404Z [2024-02-23 00:02:01,346: INFO/ForkPoolWorker-3] [19634869-7b89-4840-b219-213a408e1f81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:02:01.361242096Z [2024-02-23 00:02:01,360: INFO/ForkPoolWorker-4] [4c0c0d39-e929-4603-a0cf-8356aa2e6a1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:02:01.797392840Z [2024-02-23 00:02:01,793: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:02:01.831046107Z [2024-02-23 00:02:01,827: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:02:01.922039473Z [2024-02-23 00:02:01,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:02:01.980845583Z [2024-02-23 00:02:01,977: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:02:02.024737420Z [2024-02-23 00:02:02,021: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:02:02.077138845Z [2024-02-23 00:02:02,068: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:02:02.259754329Z [2024-02-23 00:02:02,259: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:02:02.265500925Z [2024-02-23 00:02:02,265: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:02:02.333656274Z [2024-02-23 00:02:02,333: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:02:02.339723186Z [2024-02-23 00:02:02,339: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:02:02.339933968Z [2024-02-23 00:02:02,339: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:02:02.340060904Z [2024-02-23 00:02:02,339: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:02:02.340559484Z [2024-02-23 00:02:02,340: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:02:02.509886540Z [2024-02-23 00:02:02,509: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:02:02.530032894Z [2024-02-23 00:02:02,529: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:02:03.291296165Z [2024-02-23 00:02:03,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d5610e0-f78f-4a74-bdde-ee0e82e824b4] succeeded in 1.9893252159999975s: None 2024-02-23T00:02:03.313628338Z [2024-02-23 00:02:03,313: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e6168919-9217-400e-a064-eff48a303ff5] succeeded in 1.9839075230001981s: None 2024-02-23T00:02:03.773807010Z [2024-02-23 00:02:03,773: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-23T00:02:03.777296670Z [2024-02-23 00:02:03,776: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:02:03.809697963Z [2024-02-23 00:02:03,809: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-23T00:02:03.811273721Z [2024-02-23 00:02:03,811: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:02:03.811375616Z [2024-02-23 00:02:03,811: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:02:03.811474832Z [2024-02-23 00:02:03,811: INFO/ForkPoolWorker-4] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:02:03.811669164Z [2024-02-23 00:02:03,811: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:02:03.811764262Z [2024-02-23 00:02:03,811: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-23T00:02:03.819769747Z [2024-02-23 00:02:03,818: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:02:03.819932340Z [2024-02-23 00:02:03,819: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:02:03.825581793Z [2024-02-23 00:02:03,825: INFO/ForkPoolWorker-4] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:02:03.827221351Z [2024-02-23 00:02:03,826: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:02:03.830375612Z [2024-02-23 00:02:03,830: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:02:03.830431136Z [2024-02-23 00:02:03,830: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:02:03.834387606Z [2024-02-23 00:02:03,833: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:02:03.858183670Z [2024-02-23 00:02:03,857: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:02:03.859422522Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:02:03.859440497Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:02:03.859492318Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:02:03.859629420Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:02:03.859657764Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:02:03.859994068Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:02:03.860006157Z [2024-02-23 00:02:03,859: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:02:03.864892265Z [2024-02-23 00:02:03,864: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:02:03.867767234Z [2024-02-23 00:02:03,867: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:02:03.869274877Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:02:03.869457631Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:02:03.869520321Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:02:03.869674045Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:02:03.869690720Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:02:03.869960430Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:02:03.869979192Z [2024-02-23 00:02:03,869: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:02:03.875153782Z [2024-02-23 00:02:03,874: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:02:03.963762754Z [2024-02-23 00:02:03,963: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:02:03.977325350Z [2024-02-23 00:02:03,976: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:02:04.017846677Z [2024-02-23 00:02:04,017: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:02:04.122141343Z [2024-02-23 00:02:04,121: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:02:04.131689639Z [2024-02-23 00:02:04,131: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:02:04.187788155Z [2024-02-23 00:02:04,187: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:02:04.189900035Z [2024-02-23 00:02:04,189: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:02:04.189982290Z [2024-02-23 00:02:04,189: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:02:04.190074516Z [2024-02-23 00:02:04,189: INFO/ForkPoolWorker-1] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:02:04.190237188Z [2024-02-23 00:02:04,190: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:02:04.190293175Z [2024-02-23 00:02:04,190: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:02:04.190591894Z [2024-02-23 00:02:04,190: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:02:04.190682191Z [2024-02-23 00:02:04,190: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:02:04.202005870Z [2024-02-23 00:02:04,201: INFO/ForkPoolWorker-1] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:02:04.288647858Z [2024-02-23 00:02:04,288: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:02:05.556496771Z [2024-02-23 00:02:05,555: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[4c0c0d39-e929-4603-a0cf-8356aa2e6a1e] succeeded in 4.213341527000011s: None 2024-02-23T00:02:06.593653224Z [2024-02-23 00:02:06,592: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04347600-1129-46ad-8b2b-9238adddc825] succeeded in 5.286120149999988s: None 2024-02-23T00:02:06.761235976Z [2024-02-23 00:02:06,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d3db8ec-0cde-47bd-98a7-68622c3ea0eb] succeeded in 5.459026195000206s: None 2024-02-23T00:02:07.493893256Z [2024-02-23 00:02:07,493: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[19634869-7b89-4840-b219-213a408e1f81] succeeded in 6.159113943000193s: None 2024-02-23T00:03:01.084285465Z [2024-02-23 00:03:01,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5daf16ae-aae4-43ba-9ba0-f0197318758d] received 2024-02-23T00:03:01.086796059Z [2024-02-23 00:03:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9db731ae-b754-4f88-b8b7-74c027e82501] received 2024-02-23T00:03:01.088854466Z [2024-02-23 00:03:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[441f1cd8-f0bd-4f29-a256-d7237ee024c2] received 2024-02-23T00:03:01.098058852Z [2024-02-23 00:03:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89e0052e-de4c-4bc3-b2c6-332fcc2bcace] received 2024-02-23T00:03:01.098099073Z [2024-02-23 00:03:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afce864b-bccc-4003-bccf-c3eb06d9cfcb] received 2024-02-23T00:03:01.117850790Z [2024-02-23 00:03:01,117: INFO/ForkPoolWorker-3] [afce864b-bccc-4003-bccf-c3eb06d9cfcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:03:01.123947846Z [2024-02-23 00:03:01,123: INFO/ForkPoolWorker-16] [9db731ae-b754-4f88-b8b7-74c027e82501] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:03:01.125845422Z [2024-02-23 00:03:01,125: INFO/ForkPoolWorker-1] [441f1cd8-f0bd-4f29-a256-d7237ee024c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:03:01.131774801Z [2024-02-23 00:03:01,131: INFO/ForkPoolWorker-2] [89e0052e-de4c-4bc3-b2c6-332fcc2bcace] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:03:01.139214541Z [2024-02-23 00:03:01,138: INFO/ForkPoolWorker-15] [5daf16ae-aae4-43ba-9ba0-f0197318758d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:03:01.511592187Z [2024-02-23 00:03:01,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:03:01.531825623Z [2024-02-23 00:03:01,528: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:03:01.565795261Z [2024-02-23 00:03:01,562: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:03:01.776727103Z [2024-02-23 00:03:01,773: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:03:01.852319825Z [2024-02-23 00:03:01,838: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:03:02.029815143Z [2024-02-23 00:03:02,029: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:03:02.034775565Z [2024-02-23 00:03:02,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:03:02.080226894Z [2024-02-23 00:03:02,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:03:02.083596521Z [2024-02-23 00:03:02,083: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:03:02.083951780Z [2024-02-23 00:03:02,083: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:03:02.084134999Z [2024-02-23 00:03:02,083: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:03:02.084686449Z [2024-02-23 00:03:02,084: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:03:02.205794631Z [2024-02-23 00:03:02,205: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:03:03.074421206Z [2024-02-23 00:03:03,074: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[441f1cd8-f0bd-4f29-a256-d7237ee024c2] succeeded in 1.9742539919998308s: None 2024-02-23T00:03:03.088047176Z [2024-02-23 00:03:03,087: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:03:03.092378538Z [2024-02-23 00:03:03,091: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:03:03.141809796Z [2024-02-23 00:03:03,141: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:03:03.143413694Z [2024-02-23 00:03:03,143: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:03:03.143539392Z [2024-02-23 00:03:03,143: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:03:03.143663626Z [2024-02-23 00:03:03,143: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:03:03.143877558Z [2024-02-23 00:03:03,143: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:03:03.144006101Z [2024-02-23 00:03:03,143: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:03:03.144416564Z [2024-02-23 00:03:03,144: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:03:03.144533847Z [2024-02-23 00:03:03,144: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:03:03.149037062Z [2024-02-23 00:03:03,148: INFO/ForkPoolWorker-16] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:03:03.178123240Z [2024-02-23 00:03:03,177: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:03:03.183640791Z [2024-02-23 00:03:03,183: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:03:03.233594153Z [2024-02-23 00:03:03,233: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:03:03.234574903Z [2024-02-23 00:03:03,234: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:03:03.234798526Z [2024-02-23 00:03:03,234: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:03:03.234904932Z [2024-02-23 00:03:03,234: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:03:03.234917143Z [2024-02-23 00:03:03,234: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:03:03.235089803Z [2024-02-23 00:03:03,234: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:03:03.235125869Z [2024-02-23 00:03:03,235: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:03:03.235465967Z [2024-02-23 00:03:03,235: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:03:03.235516641Z [2024-02-23 00:03:03,235: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:03:03.246780153Z [2024-02-23 00:03:03,246: INFO/ForkPoolWorker-3] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:03:03.271045667Z [2024-02-23 00:03:03,270: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:03:03.274725163Z [2024-02-23 00:03:03,274: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:03:03.300276977Z [2024-02-23 00:03:03,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:03:03.301905419Z [2024-02-23 00:03:03,301: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:03:03.302034611Z [2024-02-23 00:03:03,301: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:03:03.302190390Z [2024-02-23 00:03:03,302: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:03:03.302406366Z [2024-02-23 00:03:03,302: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:03:03.302466435Z [2024-02-23 00:03:03,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:03:03.302807506Z [2024-02-23 00:03:03,302: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:03:03.302969474Z [2024-02-23 00:03:03,302: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:03:03.307445860Z [2024-02-23 00:03:03,307: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:03:03.360205231Z [2024-02-23 00:03:03,359: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:03:03.416968692Z [2024-02-23 00:03:03,416: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:03:03.671642942Z [2024-02-23 00:03:03,671: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:03:03.674753672Z [2024-02-23 00:03:03,674: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:03:03.710431829Z [2024-02-23 00:03:03,710: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:03:03.715036778Z [2024-02-23 00:03:03,714: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:03:03.715222750Z [2024-02-23 00:03:03,714: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:03:03.715330356Z [2024-02-23 00:03:03,715: INFO/ForkPoolWorker-2] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:03:03.715528089Z [2024-02-23 00:03:03,715: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:03:03.715647680Z [2024-02-23 00:03:03,715: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:03:03.716562856Z [2024-02-23 00:03:03,715: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:03:03.716640072Z [2024-02-23 00:03:03,716: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:03:03.726191132Z [2024-02-23 00:03:03,725: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:03:03.829450737Z [2024-02-23 00:03:03,829: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:03:05.553851428Z [2024-02-23 00:03:05,552: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[afce864b-bccc-4003-bccf-c3eb06d9cfcb] succeeded in 4.446961224000006s: None 2024-02-23T00:03:05.562528023Z [2024-02-23 00:03:05,561: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9db731ae-b754-4f88-b8b7-74c027e82501] succeeded in 4.465928575999897s: None 2024-02-23T00:03:06.350209816Z [2024-02-23 00:03:06,349: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5daf16ae-aae4-43ba-9ba0-f0197318758d] succeeded in 5.255988420999984s: None 2024-02-23T00:03:07.191497906Z [2024-02-23 00:03:07,190: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[89e0052e-de4c-4bc3-b2c6-332fcc2bcace] succeeded in 6.094962621999912s: None 2024-02-23T00:04:01.074050235Z [2024-02-23 00:04:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52ef05ea-6683-4b9f-8a8f-1fe73b44d24e] received 2024-02-23T00:04:01.077394424Z [2024-02-23 00:04:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e440fe8-7ed1-4993-8fe7-bb1338cdd0c9] received 2024-02-23T00:04:01.080336792Z [2024-02-23 00:04:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7542e6f3-c666-4f03-8105-e1c3dcd80578] received 2024-02-23T00:04:01.081914429Z [2024-02-23 00:04:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10da0afa-cc75-4d60-a7e5-137b9d00a8de] received 2024-02-23T00:04:01.085498114Z [2024-02-23 00:04:01,083: INFO/ForkPoolWorker-15] [52ef05ea-6683-4b9f-8a8f-1fe73b44d24e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:04:01.086291730Z [2024-02-23 00:04:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edd4c6ba-b8fe-4baf-afc3-e80ddc1e4bd3] received 2024-02-23T00:04:01.089889708Z [2024-02-23 00:04:01,089: INFO/ForkPoolWorker-2] [10da0afa-cc75-4d60-a7e5-137b9d00a8de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:04:01.096627517Z [2024-02-23 00:04:01,096: INFO/ForkPoolWorker-1] [7542e6f3-c666-4f03-8105-e1c3dcd80578] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:04:01.096645465Z [2024-02-23 00:04:01,096: INFO/ForkPoolWorker-3] [edd4c6ba-b8fe-4baf-afc3-e80ddc1e4bd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:04:01.098972748Z [2024-02-23 00:04:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9e6f589-dd63-4942-aac6-033870f8218c] received 2024-02-23T00:04:01.103957323Z [2024-02-23 00:04:01,103: INFO/ForkPoolWorker-16] [3e440fe8-7ed1-4993-8fe7-bb1338cdd0c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:04:01.107986287Z [2024-02-23 00:04:01,107: INFO/ForkPoolWorker-4] [a9e6f589-dd63-4942-aac6-033870f8218c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:04:01.420986776Z [2024-02-23 00:04:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:04:01.532125146Z [2024-02-23 00:04:01,528: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:04:01.553318854Z [2024-02-23 00:04:01,549: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:04:01.657471148Z [2024-02-23 00:04:01,654: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:04:01.708059374Z [2024-02-23 00:04:01,696: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:04:01.969326018Z [2024-02-23 00:04:01,965: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:04:02.020342173Z [2024-02-23 00:04:02,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:04:02.249257347Z [2024-02-23 00:04:02,248: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T00:04:02.260561301Z [2024-02-23 00:04:02,260: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:04:02.312040532Z [2024-02-23 00:04:02,311: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:04:02.313780229Z [2024-02-23 00:04:02,313: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:04:02.313904780Z [2024-02-23 00:04:02,313: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:04:02.313911647Z [2024-02-23 00:04:02,313: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T00:04:02.314078937Z [2024-02-23 00:04:02,313: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:04:02.479977106Z [2024-02-23 00:04:02,479: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:04:02.881330563Z [2024-02-23 00:04:02,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52ef05ea-6683-4b9f-8a8f-1fe73b44d24e] succeeded in 1.8058005410002806s: None 2024-02-23T00:04:03.168840866Z [2024-02-23 00:04:03,168: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-23T00:04:03.178390430Z [2024-02-23 00:04:03,177: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:04:03.228244715Z [2024-02-23 00:04:03,227: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-23T00:04:03.232372996Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:04:03.232491669Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:04:03.232503116Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:04:03.232657634Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:04:03.232698982Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-23T00:04:03.233013330Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:04:03.233057645Z [2024-02-23 00:04:03,232: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:04:03.237511715Z [2024-02-23 00:04:03,237: INFO/ForkPoolWorker-4] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:04:03.299809205Z [2024-02-23 00:04:03,299: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[edd4c6ba-b8fe-4baf-afc3-e80ddc1e4bd3] succeeded in 2.211916914000085s: None 2024-02-23T00:04:03.348545279Z [2024-02-23 00:04:03,348: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:04:03.404106279Z [2024-02-23 00:04:03,403: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:04:03.407585447Z [2024-02-23 00:04:03,407: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:04:03.432138095Z [2024-02-23 00:04:03,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:04:03.434129947Z [2024-02-23 00:04:03,433: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:04:03.434273923Z [2024-02-23 00:04:03,434: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:04:03.434397124Z [2024-02-23 00:04:03,434: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:04:03.434620818Z [2024-02-23 00:04:03,434: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:04:03.434696195Z [2024-02-23 00:04:03,434: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:04:03.435340744Z [2024-02-23 00:04:03,435: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:04:03.435460050Z [2024-02-23 00:04:03,435: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:04:03.440695310Z [2024-02-23 00:04:03,440: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:04:03.522175806Z [2024-02-23 00:04:03,521: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:04:03.527385405Z [2024-02-23 00:04:03,526: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:04:03.543887900Z [2024-02-23 00:04:03,543: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:04:03.573561547Z [2024-02-23 00:04:03,573: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:04:03.577097334Z [2024-02-23 00:04:03,576: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:04:03.581679464Z [2024-02-23 00:04:03,581: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:04:03.583268454Z [2024-02-23 00:04:03,583: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:04:03.583345552Z [2024-02-23 00:04:03,583: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:04:03.583433519Z [2024-02-23 00:04:03,583: INFO/ForkPoolWorker-2] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:04:03.583681948Z [2024-02-23 00:04:03,583: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:04:03.583823219Z [2024-02-23 00:04:03,583: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:04:03.584104648Z [2024-02-23 00:04:03,583: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:04:03.584190638Z [2024-02-23 00:04:03,584: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:04:03.592372532Z [2024-02-23 00:04:03,592: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:04:03.611411078Z [2024-02-23 00:04:03,611: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:04:03.612677029Z [2024-02-23 00:04:03,612: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:04:03.612692826Z [2024-02-23 00:04:03,612: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:04:03.612717788Z [2024-02-23 00:04:03,612: INFO/ForkPoolWorker-1] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:04:03.612886820Z [2024-02-23 00:04:03,612: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:04:03.612910687Z [2024-02-23 00:04:03,612: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:04:03.613198415Z [2024-02-23 00:04:03,613: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:04:03.613228762Z [2024-02-23 00:04:03,613: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:04:03.617763357Z [2024-02-23 00:04:03,617: INFO/ForkPoolWorker-1] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:04:03.675802829Z [2024-02-23 00:04:03,675: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:04:03.730747702Z [2024-02-23 00:04:03,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:04:05.890013546Z [2024-02-23 00:04:05,889: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[a9e6f589-dd63-4942-aac6-033870f8218c] succeeded in 4.787392433999685s: None 2024-02-23T00:04:06.354022064Z [2024-02-23 00:04:06,353: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e440fe8-7ed1-4993-8fe7-bb1338cdd0c9] succeeded in 5.274311025000316s: None 2024-02-23T00:04:06.405385410Z [2024-02-23 00:04:06,404: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7542e6f3-c666-4f03-8105-e1c3dcd80578] succeeded in 5.323084689999632s: None 2024-02-23T00:04:07.054051308Z [2024-02-23 00:04:07,053: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[10da0afa-cc75-4d60-a7e5-137b9d00a8de] succeeded in 5.969748800000161s: None 2024-02-23T00:05:01.101242753Z [2024-02-23 00:05:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad304ae1-65d9-448f-be4f-b775b00a5cc4] received 2024-02-23T00:05:01.103176295Z [2024-02-23 00:05:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e4aa176-5f23-4c73-9e5f-2de003bb5228] received 2024-02-23T00:05:01.108782180Z [2024-02-23 00:05:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fc59dfb-0150-4b3f-bbe6-017e74de0bcb] received 2024-02-23T00:05:01.110073587Z [2024-02-23 00:05:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f77d4093-4dd2-477a-87a1-968968c06e6f] received 2024-02-23T00:05:01.112766320Z [2024-02-23 00:05:01,112: INFO/ForkPoolWorker-15] [ad304ae1-65d9-448f-be4f-b775b00a5cc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:05:01.113344169Z [2024-02-23 00:05:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13ef2f94-7f5e-4359-8f03-d72d60dbeba8] received 2024-02-23T00:05:01.121213324Z [2024-02-23 00:05:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4019e1fe-11a4-4904-9280-56ffbcde1a08] received 2024-02-23T00:05:01.123743593Z [2024-02-23 00:05:01,123: INFO/ForkPoolWorker-2] [f77d4093-4dd2-477a-87a1-968968c06e6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:05:01.127782443Z [2024-02-23 00:05:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16215d57-f128-4459-8a6e-7d70de2bcb28] received 2024-02-23T00:05:01.132434395Z [2024-02-23 00:05:01,132: INFO/ForkPoolWorker-3] [13ef2f94-7f5e-4359-8f03-d72d60dbeba8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:05:01.135791113Z [2024-02-23 00:05:01,135: INFO/ForkPoolWorker-4] [4019e1fe-11a4-4904-9280-56ffbcde1a08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:05:01.139187014Z [2024-02-23 00:05:01,138: INFO/ForkPoolWorker-16] [3e4aa176-5f23-4c73-9e5f-2de003bb5228] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:05:01.139495286Z [2024-02-23 00:05:01,139: INFO/ForkPoolWorker-5] [16215d57-f128-4459-8a6e-7d70de2bcb28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:05:01.147070822Z [2024-02-23 00:05:01,146: INFO/ForkPoolWorker-1] [9fc59dfb-0150-4b3f-bbe6-017e74de0bcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:05:01.538954595Z [2024-02-23 00:05:01,535: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:05:01.597566755Z [2024-02-23 00:05:01,577: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:01.658928455Z [2024-02-23 00:05:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:05:01.729200140Z [2024-02-23 00:05:01,725: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:05:01.896528479Z [2024-02-23 00:05:01,875: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:05:02.324621939Z [2024-02-23 00:05:02,321: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:02.398410148Z [2024-02-23 00:05:02,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:05:02.781972892Z [2024-02-23 00:05:02,781: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:05:02.785640071Z [2024-02-23 00:05:02,785: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:02.829723963Z [2024-02-23 00:05:02,829: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:05:02.831879612Z [2024-02-23 00:05:02,831: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:02.832055745Z [2024-02-23 00:05:02,831: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:02.832157080Z [2024-02-23 00:05:02,832: INFO/ForkPoolWorker-1] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:02.832368744Z [2024-02-23 00:05:02,832: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:02.832477848Z [2024-02-23 00:05:02,832: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:05:02.832824626Z [2024-02-23 00:05:02,832: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:05:02.832954873Z [2024-02-23 00:05:02,832: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:02.837580193Z [2024-02-23 00:05:02,837: INFO/ForkPoolWorker-1] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:02.933522239Z [2024-02-23 00:05:02,933: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:03.133819060Z [2024-02-23 00:05:03,133: INFO/ForkPoolWorker-5] Getting VIM list 2024-02-23T00:05:03.137164893Z [2024-02-23 00:05:03,136: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:03.201156559Z [2024-02-23 00:05:03,200: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-02-23T00:05:03.202516721Z [2024-02-23 00:05:03,202: INFO/ForkPoolWorker-5] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:03.202669236Z [2024-02-23 00:05:03,202: INFO/ForkPoolWorker-5] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:03.202762181Z [2024-02-23 00:05:03,202: INFO/ForkPoolWorker-5] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:03.203002165Z [2024-02-23 00:05:03,202: INFO/ForkPoolWorker-5] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:03.203316684Z [2024-02-23 00:05:03,203: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-02-23T00:05:03.205248687Z [2024-02-23 00:05:03,204: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:05:03.205568217Z [2024-02-23 00:05:03,205: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:03.213203046Z [2024-02-23 00:05:03,212: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:03.228462313Z [2024-02-23 00:05:03,228: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:05:03.246434936Z [2024-02-23 00:05:03,245: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:03.297371802Z [2024-02-23 00:05:03,297: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:05:03.303316574Z [2024-02-23 00:05:03,303: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:05:03.303343659Z [2024-02-23 00:05:03,303: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:05:03.303415684Z [2024-02-23 00:05:03,303: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:05:03.303611269Z [2024-02-23 00:05:03,303: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:05:03.324419298Z [2024-02-23 00:05:03,324: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:03.391812430Z [2024-02-23 00:05:03,391: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:03.603321648Z [2024-02-23 00:05:03,602: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:05:03.625218914Z [2024-02-23 00:05:03,619: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:03.695657897Z [2024-02-23 00:05:03,695: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:05:03.700373519Z [2024-02-23 00:05:03,700: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:03.700567861Z [2024-02-23 00:05:03,700: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:03.700747157Z [2024-02-23 00:05:03,700: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:03.701029779Z [2024-02-23 00:05:03,700: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:03.701255632Z [2024-02-23 00:05:03,700: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:05:03.701589007Z [2024-02-23 00:05:03,701: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:05:03.701718938Z [2024-02-23 00:05:03,701: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:03.707739723Z [2024-02-23 00:05:03,707: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:03.804244967Z [2024-02-23 00:05:03,803: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:04.276301554Z [2024-02-23 00:05:04,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad304ae1-65d9-448f-be4f-b775b00a5cc4] succeeded in 3.1706204369997977s: None 2024-02-23T00:05:04.451101540Z [2024-02-23 00:05:04,450: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:05:04.454170815Z [2024-02-23 00:05:04,453: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:04.477786289Z [2024-02-23 00:05:04,477: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:05:04.479561389Z [2024-02-23 00:05:04,479: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:04.479599552Z [2024-02-23 00:05:04,479: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:04.479615126Z [2024-02-23 00:05:04,479: INFO/ForkPoolWorker-2] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:04.479836673Z [2024-02-23 00:05:04,479: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:04.479871831Z [2024-02-23 00:05:04,479: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:05:04.480142157Z [2024-02-23 00:05:04,479: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:04.480160151Z [2024-02-23 00:05:04,480: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:04.486662594Z [2024-02-23 00:05:04,486: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:04.538599365Z [2024-02-23 00:05:04,538: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-23T00:05:04.542258427Z [2024-02-23 00:05:04,541: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:04.574987269Z [2024-02-23 00:05:04,574: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-23T00:05:04.576510938Z [2024-02-23 00:05:04,576: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:04.576776717Z [2024-02-23 00:05:04,576: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:04.576960426Z [2024-02-23 00:05:04,576: INFO/ForkPoolWorker-4] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:04.577209794Z [2024-02-23 00:05:04,576: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:04.577385370Z [2024-02-23 00:05:04,577: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-23T00:05:04.577793165Z [2024-02-23 00:05:04,577: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:05:04.577965467Z [2024-02-23 00:05:04,577: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:04.582795093Z [2024-02-23 00:05:04,582: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:04.583080185Z [2024-02-23 00:05:04,582: INFO/ForkPoolWorker-4] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:04.718925651Z [2024-02-23 00:05:04,715: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:04.960915918Z [2024-02-23 00:05:04,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9fc59dfb-0150-4b3f-bbe6-017e74de0bcb] succeeded in 3.847183978999965s: None 2024-02-23T00:05:04.989832912Z [2024-02-23 00:05:04,989: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:05:04.993503282Z [2024-02-23 00:05:04,992: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:05.024771517Z [2024-02-23 00:05:05,024: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:05:05.025942910Z [2024-02-23 00:05:05,025: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:05.025962060Z [2024-02-23 00:05:05,025: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:05.026016529Z [2024-02-23 00:05:05,025: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:05.026172075Z [2024-02-23 00:05:05,025: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:05.026182287Z [2024-02-23 00:05:05,026: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:05:05.026371763Z [2024-02-23 00:05:05,026: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:05.026381929Z [2024-02-23 00:05:05,026: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:05.032401289Z [2024-02-23 00:05:05,032: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:05.107174208Z [2024-02-23 00:05:05,106: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[16215d57-f128-4459-8a6e-7d70de2bcb28] succeeded in 3.976842981000118s: None 2024-02-23T00:05:05.144800406Z [2024-02-23 00:05:05,143: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:05.362774726Z [2024-02-23 00:05:05,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a5a2b05-6c2a-4212-9168-4300bc16d9c5] received 2024-02-23T00:05:05.373093916Z [2024-02-23 00:05:05,372: INFO/ForkPoolWorker-15] [3a5a2b05-6c2a-4212-9168-4300bc16d9c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:05:05.422808591Z [2024-02-23 00:05:05,422: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f77d4093-4dd2-477a-87a1-968968c06e6f] succeeded in 4.309898022000198s: None 2024-02-23T00:05:05.697426241Z [2024-02-23 00:05:05,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:05.810796277Z [2024-02-23 00:05:05,810: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[13ef2f94-7f5e-4359-8f03-d72d60dbeba8] succeeded in 4.694777617999989s: None 2024-02-23T00:05:05.909397206Z [2024-02-23 00:05:05,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e4aa176-5f23-4c73-9e5f-2de003bb5228] succeeded in 4.80379425000001s: None 2024-02-23T00:05:06.350980909Z [2024-02-23 00:05:06,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c220f045-497a-44b6-856c-14031e691f82] received 2024-02-23T00:05:06.358059087Z [2024-02-23 00:05:06,357: INFO/ForkPoolWorker-16] [c220f045-497a-44b6-856c-14031e691f82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'split_metrics', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:05:06.656896062Z [2024-02-23 00:05:06,653: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:06.846864469Z [2024-02-23 00:05:06,846: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[4019e1fe-11a4-4904-9280-56ffbcde1a08] succeeded in 5.717806603000099s: None 2024-02-23T00:05:06.908717994Z [2024-02-23 00:05:06,908: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:05:06.912427029Z [2024-02-23 00:05:06,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:06.935281226Z [2024-02-23 00:05:06,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:05:06.936681544Z [2024-02-23 00:05:06,936: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:06.936699111Z [2024-02-23 00:05:06,936: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:06.936763627Z [2024-02-23 00:05:06,936: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:06.936884459Z [2024-02-23 00:05:06,936: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:06.936894895Z [2024-02-23 00:05:06,936: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:05:06.937139636Z [2024-02-23 00:05:06,937: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:06.937152297Z [2024-02-23 00:05:06,937: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:06.944656400Z [2024-02-23 00:05:06,944: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:07.042632835Z [2024-02-23 00:05:07,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:07.769771943Z [2024-02-23 00:05:07,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a5a2b05-6c2a-4212-9168-4300bc16d9c5] succeeded in 2.4055945729996893s: None 2024-02-23T00:05:07.820729285Z [2024-02-23 00:05:07,820: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:05:07.824119026Z [2024-02-23 00:05:07,823: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:07.852353343Z [2024-02-23 00:05:07,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:05:07.854941500Z [2024-02-23 00:05:07,854: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:07.855147697Z [2024-02-23 00:05:07,854: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:07.855366340Z [2024-02-23 00:05:07,855: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:07.855699990Z [2024-02-23 00:05:07,855: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:07.855926427Z [2024-02-23 00:05:07,855: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:05:07.856373186Z [2024-02-23 00:05:07,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:07.857060179Z [2024-02-23 00:05:07,856: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:07.867772716Z [2024-02-23 00:05:07,867: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:07.965307132Z [2024-02-23 00:05:07,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:08.029609243Z [2024-02-23 00:05:08,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39af0871-659b-46ae-b8f5-3fe577986a00] received 2024-02-23T00:05:08.042988443Z [2024-02-23 00:05:08,042: INFO/ForkPoolWorker-15] [39af0871-659b-46ae-b8f5-3fe577986a00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:05:08.355440975Z [2024-02-23 00:05:08,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:08.654481935Z [2024-02-23 00:05:08,653: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c220f045-497a-44b6-856c-14031e691f82] succeeded in 2.301563123000051s: None 2024-02-23T00:05:09.275483511Z [2024-02-23 00:05:09,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[187d3224-53f3-4877-b4f9-c9a069b7f721] received 2024-02-23T00:05:09.290474672Z [2024-02-23 00:05:09,290: INFO/ForkPoolWorker-16] [187d3224-53f3-4877-b4f9-c9a069b7f721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'collect_metrics', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:05:09.462090212Z [2024-02-23 00:05:09,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:05:09.465569291Z [2024-02-23 00:05:09,465: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:09.488575735Z [2024-02-23 00:05:09,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:05:09.490146606Z [2024-02-23 00:05:09,489: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:09.490272710Z [2024-02-23 00:05:09,490: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:09.490389125Z [2024-02-23 00:05:09,490: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:09.490599994Z [2024-02-23 00:05:09,490: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:09.490742589Z [2024-02-23 00:05:09,490: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:05:09.491120158Z [2024-02-23 00:05:09,490: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:09.491287513Z [2024-02-23 00:05:09,491: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:09.498065764Z [2024-02-23 00:05:09,497: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:09.594858569Z [2024-02-23 00:05:09,594: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:09.614339175Z [2024-02-23 00:05:09,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:10.207295700Z [2024-02-23 00:05:10,206: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39af0871-659b-46ae-b8f5-3fe577986a00] succeeded in 2.1730124549999346s: None 2024-02-23T00:05:10.548738960Z [2024-02-23 00:05:10,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21eb2ed1-1dcf-4017-917c-033bf294456a] received 2024-02-23T00:05:10.558148130Z [2024-02-23 00:05:10,557: INFO/ForkPoolWorker-15] [21eb2ed1-1dcf-4017-917c-033bf294456a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:05:10.760321851Z [2024-02-23 00:05:10,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:05:10.764017101Z [2024-02-23 00:05:10,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:10.784817021Z [2024-02-23 00:05:10,784: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:05:10.786304723Z [2024-02-23 00:05:10,786: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:10.786421520Z [2024-02-23 00:05:10,786: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:10.786578739Z [2024-02-23 00:05:10,786: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:10.786928958Z [2024-02-23 00:05:10,786: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:10.787038761Z [2024-02-23 00:05:10,786: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:05:10.787395064Z [2024-02-23 00:05:10,787: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:10.787445774Z [2024-02-23 00:05:10,787: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:10.794635983Z [2024-02-23 00:05:10,794: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:10.854564101Z [2024-02-23 00:05:10,851: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:10.886362973Z [2024-02-23 00:05:10,885: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:11.532408948Z [2024-02-23 00:05:11,531: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[187d3224-53f3-4877-b4f9-c9a069b7f721] succeeded in 2.2538558700002795s: None 2024-02-23T00:05:11.829075140Z [2024-02-23 00:05:11,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27b7bd3b-d098-4044-8a8f-0007eda49886] received 2024-02-23T00:05:11.842777343Z [2024-02-23 00:05:11,842: INFO/ForkPoolWorker-16] [27b7bd3b-d098-4044-8a8f-0007eda49886] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'send_prometheus', 'scheduled__2024-02-23T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:05:11.948517166Z [2024-02-23 00:05:11,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:05:11.951817696Z [2024-02-23 00:05:11,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:11.974161875Z [2024-02-23 00:05:11,973: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:05:11.976321512Z [2024-02-23 00:05:11,976: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:11.976341449Z [2024-02-23 00:05:11,976: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:11.976527050Z [2024-02-23 00:05:11,976: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:11.976913778Z [2024-02-23 00:05:11,976: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:11.977027817Z [2024-02-23 00:05:11,976: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:05:11.977510967Z [2024-02-23 00:05:11,977: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:11.977665491Z [2024-02-23 00:05:11,977: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:11.984018469Z [2024-02-23 00:05:11,983: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:12.071390327Z [2024-02-23 00:05:12,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:12.131115395Z [2024-02-23 00:05:12,127: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:05:12.670218357Z [2024-02-23 00:05:12,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21eb2ed1-1dcf-4017-917c-033bf294456a] succeeded in 2.1188092329998653s: None 2024-02-23T00:05:13.276919803Z [2024-02-23 00:05:13,276: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:05:13.280453275Z [2024-02-23 00:05:13,279: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:05:13.302409197Z [2024-02-23 00:05:13,302: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:05:13.304189411Z [2024-02-23 00:05:13,303: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:05:13.305144086Z [2024-02-23 00:05:13,304: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:05:13.305358156Z [2024-02-23 00:05:13,305: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:05:13.305626728Z [2024-02-23 00:05:13,305: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:05:13.305825408Z [2024-02-23 00:05:13,305: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:05:13.306208829Z [2024-02-23 00:05:13,306: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:05:13.306394919Z [2024-02-23 00:05:13,306: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:05:13.313749636Z [2024-02-23 00:05:13,313: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:05:13.423143065Z [2024-02-23 00:05:13,422: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:05:14.110111804Z [2024-02-23 00:05:14,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27b7bd3b-d098-4044-8a8f-0007eda49886] succeeded in 2.277346630000011s: None 2024-02-23T00:06:01.221087686Z [2024-02-23 00:06:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fcf9261-d916-4d91-a262-29573da55a7f] received 2024-02-23T00:06:01.223646721Z [2024-02-23 00:06:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e377d8ce-fa1c-40aa-acf6-67d2fa251090] received 2024-02-23T00:06:01.232727887Z [2024-02-23 00:06:01,232: INFO/ForkPoolWorker-16] [e377d8ce-fa1c-40aa-acf6-67d2fa251090] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:06:01.233699832Z [2024-02-23 00:06:01,233: INFO/ForkPoolWorker-15] [5fcf9261-d916-4d91-a262-29573da55a7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:06:01.236797826Z [2024-02-23 00:06:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99c5ecc9-6d9a-479c-ab95-674f670ff734] received 2024-02-23T00:06:01.240146706Z [2024-02-23 00:06:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4898a9c-5e19-42c7-b7eb-5bea0ed13d4e] received 2024-02-23T00:06:01.241661797Z [2024-02-23 00:06:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a8dd289-4aa8-43cd-bae4-ae3cd9b67ad2] received 2024-02-23T00:06:01.243178655Z [2024-02-23 00:06:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[541960c9-5308-47a4-a907-107721a4188a] received 2024-02-23T00:06:01.249462752Z [2024-02-23 00:06:01,249: INFO/ForkPoolWorker-2] [d4898a9c-5e19-42c7-b7eb-5bea0ed13d4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:06:01.255842890Z [2024-02-23 00:06:01,255: INFO/ForkPoolWorker-4] [541960c9-5308-47a4-a907-107721a4188a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:06:01.261181897Z [2024-02-23 00:06:01,258: INFO/ForkPoolWorker-3] [7a8dd289-4aa8-43cd-bae4-ae3cd9b67ad2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:06:01.261371292Z [2024-02-23 00:06:01,259: INFO/ForkPoolWorker-1] [99c5ecc9-6d9a-479c-ab95-674f670ff734] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:06:01.687095259Z [2024-02-23 00:06:01,682: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:06:01.947411123Z [2024-02-23 00:06:01,925: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:06:02.027866457Z [2024-02-23 00:06:02,024: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:06:02.146499422Z [2024-02-23 00:06:02,132: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:06:02.198510789Z [2024-02-23 00:06:02,198: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:06:02.402993484Z [2024-02-23 00:06:02,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:06:02.550806171Z [2024-02-23 00:06:02,533: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:06:03.237595099Z [2024-02-23 00:06:03,237: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99c5ecc9-6d9a-479c-ab95-674f670ff734] succeeded in 1.9990563960000145s: None 2024-02-23T00:06:03.303173272Z [2024-02-23 00:06:03,302: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:06:03.337094067Z [2024-02-23 00:06:03,335: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:06:03.410858937Z [2024-02-23 00:06:03,410: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:06:03.414268748Z [2024-02-23 00:06:03,413: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:06:03.415909249Z [2024-02-23 00:06:03,415: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:06:03.416051206Z [2024-02-23 00:06:03,415: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:06:03.416361521Z [2024-02-23 00:06:03,416: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:06:03.766922003Z [2024-02-23 00:06:03,766: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:06:03.952186268Z [2024-02-23 00:06:03,951: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:06:03.955389285Z [2024-02-23 00:06:03,954: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:06:03.979160457Z [2024-02-23 00:06:03,978: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:06:03.982159490Z [2024-02-23 00:06:03,981: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:06:03.982202839Z [2024-02-23 00:06:03,982: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:06:03.982292530Z [2024-02-23 00:06:03,982: INFO/ForkPoolWorker-2] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:06:03.982504585Z [2024-02-23 00:06:03,982: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:06:03.982572632Z [2024-02-23 00:06:03,982: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:06:03.982942243Z [2024-02-23 00:06:03,982: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:06:03.983385855Z [2024-02-23 00:06:03,983: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:06:03.989453649Z [2024-02-23 00:06:03,988: INFO/ForkPoolWorker-2] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:06:04.072172620Z [2024-02-23 00:06:04,071: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:06:04.462498339Z [2024-02-23 00:06:04,462: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:06:04.478554042Z [2024-02-23 00:06:04,478: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:06:04.575447613Z [2024-02-23 00:06:04,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:06:04.579703692Z [2024-02-23 00:06:04,579: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:06:04.583292597Z [2024-02-23 00:06:04,583: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:06:04.583363381Z [2024-02-23 00:06:04,583: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:06:04.583636881Z [2024-02-23 00:06:04,583: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:06:04.587143397Z [2024-02-23 00:06:04,586: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:06:04.587490594Z [2024-02-23 00:06:04,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:06:04.587969797Z [2024-02-23 00:06:04,587: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:06:04.615660019Z [2024-02-23 00:06:04,615: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:06:04.716244995Z [2024-02-23 00:06:04,706: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:06:04.716268693Z [2024-02-23 00:06:04,714: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:06:04.769992246Z [2024-02-23 00:06:04,769: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:06:04.771201364Z [2024-02-23 00:06:04,771: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:06:04.771329321Z [2024-02-23 00:06:04,771: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:06:04.771386234Z [2024-02-23 00:06:04,771: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:06:04.771713426Z [2024-02-23 00:06:04,771: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:06:04.771875075Z [2024-02-23 00:06:04,771: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:06:04.772132694Z [2024-02-23 00:06:04,772: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:06:04.772357378Z [2024-02-23 00:06:04,772: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:06:04.777125141Z [2024-02-23 00:06:04,776: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:06:04.860502783Z [2024-02-23 00:06:04,860: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:06:04.934903109Z [2024-02-23 00:06:04,934: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:06:05.026362460Z [2024-02-23 00:06:05,025: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fcf9261-d916-4d91-a262-29573da55a7f] succeeded in 3.801147587000287s: None 2024-02-23T00:06:05.202188379Z [2024-02-23 00:06:05,200: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-23T00:06:05.204607774Z [2024-02-23 00:06:05,204: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:06:05.231546679Z [2024-02-23 00:06:05,231: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-23T00:06:05.233834265Z [2024-02-23 00:06:05,233: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:06:05.234062611Z [2024-02-23 00:06:05,233: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:06:05.234178999Z [2024-02-23 00:06:05,234: INFO/ForkPoolWorker-4] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:06:05.234376222Z [2024-02-23 00:06:05,234: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:06:05.234467731Z [2024-02-23 00:06:05,234: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-23T00:06:05.234878439Z [2024-02-23 00:06:05,234: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:06:05.234998267Z [2024-02-23 00:06:05,234: INFO/ForkPoolWorker-4] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:06:05.239423248Z [2024-02-23 00:06:05,239: INFO/ForkPoolWorker-4] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:06:05.323303969Z [2024-02-23 00:06:05,323: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:06:07.414735140Z [2024-02-23 00:06:07,414: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d4898a9c-5e19-42c7-b7eb-5bea0ed13d4e] succeeded in 6.172237150000001s: None 2024-02-23T00:06:07.907196159Z [2024-02-23 00:06:07,906: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[541960c9-5308-47a4-a907-107721a4188a] succeeded in 6.66216005699971s: None 2024-02-23T00:06:08.516390147Z [2024-02-23 00:06:08,515: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7a8dd289-4aa8-43cd-bae4-ae3cd9b67ad2] succeeded in 7.271348718999889s: None 2024-02-23T00:06:08.562018796Z [2024-02-23 00:06:08,560: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e377d8ce-fa1c-40aa-acf6-67d2fa251090] succeeded in 7.333307978999983s: None 2024-02-23T00:07:01.303726953Z [2024-02-23 00:07:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89a0787b-6de6-47b7-b753-12126b883ebb] received 2024-02-23T00:07:01.309033892Z [2024-02-23 00:07:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af04fb7c-3b00-42b2-bda6-fa0bb22dba58] received 2024-02-23T00:07:01.317401987Z [2024-02-23 00:07:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02a3070f-a3cd-4e40-a9a2-bf0ff1470d68] received 2024-02-23T00:07:01.320677342Z [2024-02-23 00:07:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e2792e7-96f7-460b-9db8-fe54df247cd0] received 2024-02-23T00:07:01.321264570Z [2024-02-23 00:07:01,320: INFO/ForkPoolWorker-16] [af04fb7c-3b00-42b2-bda6-fa0bb22dba58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:07:01.324645802Z [2024-02-23 00:07:01,322: INFO/ForkPoolWorker-15] [89a0787b-6de6-47b7-b753-12126b883ebb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:07:01.327979135Z [2024-02-23 00:07:01,327: INFO/ForkPoolWorker-1] [02a3070f-a3cd-4e40-a9a2-bf0ff1470d68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:07:01.330370185Z [2024-02-23 00:07:01,330: INFO/ForkPoolWorker-2] [9e2792e7-96f7-460b-9db8-fe54df247cd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:07:01.334927994Z [2024-02-23 00:07:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e20d75c3-d6b1-4f24-8aff-4eddaa8efa99] received 2024-02-23T00:07:01.352334038Z [2024-02-23 00:07:01,352: INFO/ForkPoolWorker-3] [e20d75c3-d6b1-4f24-8aff-4eddaa8efa99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:07:01.658575851Z [2024-02-23 00:07:01,655: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:07:01.691824846Z [2024-02-23 00:07:01,688: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:07:01.807136472Z [2024-02-23 00:07:01,802: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:07:01.862062739Z [2024-02-23 00:07:01,858: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:07:01.864919789Z [2024-02-23 00:07:01,864: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:07:01.870300282Z [2024-02-23 00:07:01,866: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:07:01.870456571Z [2024-02-23 00:07:01,870: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:07:01.902523416Z [2024-02-23 00:07:01,902: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:07:01.904449377Z [2024-02-23 00:07:01,904: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:07:01.904926447Z [2024-02-23 00:07:01,904: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:07:01.905041641Z [2024-02-23 00:07:01,904: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:07:01.905277255Z [2024-02-23 00:07:01,905: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:07:02.039274444Z [2024-02-23 00:07:02,039: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:07:02.716080394Z [2024-02-23 00:07:02,715: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9e2792e7-96f7-460b-9db8-fe54df247cd0] succeeded in 1.3935736990001715s: None 2024-02-23T00:07:03.200101918Z [2024-02-23 00:07:03,199: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:07:03.204894965Z [2024-02-23 00:07:03,204: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:07:03.241234357Z [2024-02-23 00:07:03,241: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:07:03.246500802Z [2024-02-23 00:07:03,246: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:07:03.247418876Z [2024-02-23 00:07:03,247: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:07:03.247997188Z [2024-02-23 00:07:03,247: INFO/ForkPoolWorker-15] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:07:03.248983034Z [2024-02-23 00:07:03,248: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:07:03.249052334Z [2024-02-23 00:07:03,248: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:07:03.249349008Z [2024-02-23 00:07:03,249: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:07:03.250282387Z [2024-02-23 00:07:03,250: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:07:03.256277685Z [2024-02-23 00:07:03,256: INFO/ForkPoolWorker-15] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:07:03.315845428Z [2024-02-23 00:07:03,315: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:07:03.322254038Z [2024-02-23 00:07:03,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:07:03.373133390Z [2024-02-23 00:07:03,372: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:07:03.374509632Z [2024-02-23 00:07:03,374: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:07:03.374625804Z [2024-02-23 00:07:03,374: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:07:03.374684340Z [2024-02-23 00:07:03,374: INFO/ForkPoolWorker-1] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:07:03.374873385Z [2024-02-23 00:07:03,374: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:07:03.374969500Z [2024-02-23 00:07:03,374: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:07:03.375231755Z [2024-02-23 00:07:03,375: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:07:03.375298375Z [2024-02-23 00:07:03,375: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:07:03.379527914Z [2024-02-23 00:07:03,379: INFO/ForkPoolWorker-1] Creating DAG vim_status_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:07:03.384945729Z [2024-02-23 00:07:03,384: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:07:03.489548991Z [2024-02-23 00:07:03,489: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:07:03.493221254Z [2024-02-23 00:07:03,492: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:07:03.506655599Z [2024-02-23 00:07:03,506: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:07:03.518558654Z [2024-02-23 00:07:03,518: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:07:03.520507262Z [2024-02-23 00:07:03,520: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:07:03.520681126Z [2024-02-23 00:07:03,520: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:07:03.520899236Z [2024-02-23 00:07:03,520: INFO/ForkPoolWorker-16] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:07:03.521109105Z [2024-02-23 00:07:03,520: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:07:03.521233709Z [2024-02-23 00:07:03,521: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:07:03.521534356Z [2024-02-23 00:07:03,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:07:03.521647918Z [2024-02-23 00:07:03,521: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:07:03.523684928Z [2024-02-23 00:07:03,523: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:07:03.526981567Z [2024-02-23 00:07:03,526: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:07:03.527243291Z [2024-02-23 00:07:03,526: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:07:03.560036676Z [2024-02-23 00:07:03,559: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:07:03.568228141Z [2024-02-23 00:07:03,567: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:07:03.568254633Z [2024-02-23 00:07:03,568: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:07:03.568344639Z [2024-02-23 00:07:03,568: INFO/ForkPoolWorker-3] Read VIM 849dbe84-3929-40dd-86bc-883acccf1b48 (basic_08_vim_test) 2024-02-23T00:07:03.568526704Z [2024-02-23 00:07:03,568: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '849dbe84-3929-40dd-86bc-883acccf1b48', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-02-23T00:07:03.568665684Z [2024-02-23 00:07:03,568: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:07:03.568991436Z [2024-02-23 00:07:03,568: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:07:03.569008842Z [2024-02-23 00:07:03,568: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:07:03.575422490Z [2024-02-23 00:07:03,575: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48 2024-02-23T00:07:03.620704343Z [2024-02-23 00:07:03,620: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:07:03.745841441Z [2024-02-23 00:07:03,745: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:07:05.546363247Z [2024-02-23 00:07:05,545: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[02a3070f-a3cd-4e40-a9a2-bf0ff1470d68] succeeded in 4.225558469000134s: None 2024-02-23T00:07:06.006973603Z [2024-02-23 00:07:06,006: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89a0787b-6de6-47b7-b753-12126b883ebb] succeeded in 4.699687576000088s: None 2024-02-23T00:07:07.289876311Z [2024-02-23 00:07:07,289: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af04fb7c-3b00-42b2-bda6-fa0bb22dba58] succeeded in 5.97760547300004s: None 2024-02-23T00:07:07.684104205Z [2024-02-23 00:07:07,683: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e20d75c3-d6b1-4f24-8aff-4eddaa8efa99] succeeded in 6.347427187999983s: None 2024-02-23T00:08:01.166800567Z [2024-02-23 00:08:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87775cdf-3d73-491a-bf4b-c933e1df3d81] received 2024-02-23T00:08:01.172737411Z [2024-02-23 00:08:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[489ca9be-98db-4ca5-b07f-0ee175ad6e8c] received 2024-02-23T00:08:01.174071678Z [2024-02-23 00:08:01,173: INFO/ForkPoolWorker-15] [87775cdf-3d73-491a-bf4b-c933e1df3d81] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:08:01.176298344Z [2024-02-23 00:08:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb0ddbc8-2c98-4e83-9920-1fa77a2e7725] received 2024-02-23T00:08:01.182668312Z [2024-02-23 00:08:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b92072a1-9029-4815-b20b-a037cce2a748] received 2024-02-23T00:08:01.183450866Z [2024-02-23 00:08:01,183: INFO/ForkPoolWorker-16] [489ca9be-98db-4ca5-b07f-0ee175ad6e8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:08:01.183517995Z [2024-02-23 00:08:01,183: INFO/ForkPoolWorker-1] [bb0ddbc8-2c98-4e83-9920-1fa77a2e7725] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:08:01.191737117Z [2024-02-23 00:08:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4e351d1-9989-4d06-b356-11187031299b] received 2024-02-23T00:08:01.196711710Z [2024-02-23 00:08:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78f7deeb-d612-4789-b411-3280ef3315fd] received 2024-02-23T00:08:01.197465802Z [2024-02-23 00:08:01,197: INFO/ForkPoolWorker-3] [e4e351d1-9989-4d06-b356-11187031299b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:08:01.199312097Z [2024-02-23 00:08:01,199: INFO/ForkPoolWorker-2] [b92072a1-9029-4815-b20b-a037cce2a748] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:08:01.208259072Z [2024-02-23 00:08:01,207: INFO/ForkPoolWorker-4] [78f7deeb-d612-4789-b411-3280ef3315fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:08:01.510877836Z [2024-02-23 00:08:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:01.522229709Z [2024-02-23 00:08:01,519: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:08:01.529244596Z [2024-02-23 00:08:01,525: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:08:01.750867863Z [2024-02-23 00:08:01,750: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T00:08:01.755222979Z [2024-02-23 00:08:01,754: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:01.792055755Z [2024-02-23 00:08:01,791: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:08:01.794851826Z [2024-02-23 00:08:01,794: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:08:01.795386767Z [2024-02-23 00:08:01,795: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:08:01.795608640Z [2024-02-23 00:08:01,795: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T00:08:01.795938027Z [2024-02-23 00:08:01,795: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:08:01.867338378Z [2024-02-23 00:08:01,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:08:02.007822507Z [2024-02-23 00:08:02,007: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:08:02.056020967Z [2024-02-23 00:08:02,050: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:02.078532753Z [2024-02-23 00:08:02,075: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:02.199252666Z [2024-02-23 00:08:02,195: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:02.846348200Z [2024-02-23 00:08:02,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87775cdf-3d73-491a-bf4b-c933e1df3d81] succeeded in 1.6777036250000492s: None 2024-02-23T00:08:03.064350653Z [2024-02-23 00:08:03,063: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e4e351d1-9989-4d06-b356-11187031299b] succeeded in 1.8713504069996816s: None 2024-02-23T00:08:03.179795317Z [2024-02-23 00:08:03,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:08:03.183346181Z [2024-02-23 00:08:03,182: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:03.259790196Z [2024-02-23 00:08:03,259: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:08:03.269201591Z [2024-02-23 00:08:03,268: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:03.269479090Z [2024-02-23 00:08:03,269: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:03.270109821Z [2024-02-23 00:08:03,269: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:03.270431114Z [2024-02-23 00:08:03,270: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:08:03.271403259Z [2024-02-23 00:08:03,271: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:08:03.271630587Z [2024-02-23 00:08:03,271: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:03.281760536Z [2024-02-23 00:08:03,281: WARNING/ForkPoolWorker-1] Dag 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:03.283043411Z [2024-02-23 00:08:03,282: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:03.284606047Z [2024-02-23 00:08:03,284: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:08:03.288872637Z [2024-02-23 00:08:03,288: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:03.304215366Z [2024-02-23 00:08:03,303: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:08:03.305760222Z [2024-02-23 00:08:03,305: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:03.305821168Z [2024-02-23 00:08:03,305: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:03.306090816Z [2024-02-23 00:08:03,305: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:03.306190420Z [2024-02-23 00:08:03,306: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:08:03.306750060Z [2024-02-23 00:08:03,306: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:08:03.307014794Z [2024-02-23 00:08:03,306: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:03.310799264Z [2024-02-23 00:08:03,310: ERROR/ForkPoolWorker-1] [bb0ddbc8-2c98-4e83-9920-1fa77a2e7725] Failed to execute task Dag 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse.. 2024-02-23T00:08:03.310819104Z Traceback (most recent call last): 2024-02-23T00:08:03.310845844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T00:08:03.310854465Z args.func(args) 2024-02-23T00:08:03.310859386Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T00:08:03.310865864Z return func(*args, **kwargs) 2024-02-23T00:08:03.310869985Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T00:08:03.310873612Z return f(*args, **kwargs) 2024-02-23T00:08:03.310877639Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T00:08:03.310881282Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T00:08:03.310884950Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T00:08:03.310888532Z raise AirflowException( 2024-02-23T00:08:03.310894857Z airflow.exceptions.AirflowException: Dag 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse. 2024-02-23T00:08:03.361263597Z [2024-02-23 00:08:03,360: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb0ddbc8-2c98-4e83-9920-1fa77a2e7725] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bb0ddbc8-2c98-4e83-9920-1fa77a2e7725') 2024-02-23T00:08:03.361298465Z Traceback (most recent call last): 2024-02-23T00:08:03.361304016Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T00:08:03.361308039Z R = retval = fun(*args, **kwargs) 2024-02-23T00:08:03.361311284Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T00:08:03.361326970Z return self.run(*args, **kwargs) 2024-02-23T00:08:03.361330939Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T00:08:03.361336116Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T00:08:03.361339143Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T00:08:03.361343071Z raise AirflowException(msg) 2024-02-23T00:08:03.361348379Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bb0ddbc8-2c98-4e83-9920-1fa77a2e7725 2024-02-23T00:08:03.692256699Z [2024-02-23 00:08:03,691: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:08:03.695511633Z [2024-02-23 00:08:03,695: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:03.723801624Z [2024-02-23 00:08:03,723: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:08:03.724995031Z [2024-02-23 00:08:03,724: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:03.725058361Z [2024-02-23 00:08:03,724: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:03.725257105Z [2024-02-23 00:08:03,725: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:03.725273329Z [2024-02-23 00:08:03,725: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:08:03.727439983Z [2024-02-23 00:08:03,725: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:08:03.727455064Z [2024-02-23 00:08:03,725: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:03.815323135Z [2024-02-23 00:08:03,814: INFO/ForkPoolWorker-4] Getting VIM list 2024-02-23T00:08:03.818321793Z [2024-02-23 00:08:03,817: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:03.818371934Z [2024-02-23 00:08:03,818: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:08:03.842954575Z [2024-02-23 00:08:03,842: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-02-23T00:08:03.845335110Z [2024-02-23 00:08:03,844: INFO/ForkPoolWorker-4] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:03.845572050Z [2024-02-23 00:08:03,845: INFO/ForkPoolWorker-4] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:03.845953014Z [2024-02-23 00:08:03,845: INFO/ForkPoolWorker-4] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:03.846202967Z [2024-02-23 00:08:03,845: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-02-23T00:08:03.846817533Z [2024-02-23 00:08:03,846: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:08:03.847149992Z [2024-02-23 00:08:03,846: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:03.923319911Z [2024-02-23 00:08:03,923: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:08:03.930214618Z [2024-02-23 00:08:03,929: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:08:03.942842199Z [2024-02-23 00:08:03,942: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:03.981895784Z [2024-02-23 00:08:03,981: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:08:03.983241868Z [2024-02-23 00:08:03,982: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:03.983290023Z [2024-02-23 00:08:03,983: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:03.983543274Z [2024-02-23 00:08:03,983: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:03.983606301Z [2024-02-23 00:08:03,983: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:08:03.984062748Z [2024-02-23 00:08:03,983: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:08:03.984106796Z [2024-02-23 00:08:03,983: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:03.991861552Z [2024-02-23 00:08:03,991: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:03.993078535Z [2024-02-23 00:08:03,991: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:03.994086687Z [2024-02-23 00:08:03,993: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:08:03.997137319Z [2024-02-23 00:08:03,996: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:04.014162897Z [2024-02-23 00:08:04,013: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:08:04.015586198Z [2024-02-23 00:08:04,015: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:04.015638803Z [2024-02-23 00:08:04,015: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:04.015833286Z [2024-02-23 00:08:04,015: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:04.015886139Z [2024-02-23 00:08:04,015: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:08:04.024760304Z [2024-02-23 00:08:04,024: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:08:04.024876074Z [2024-02-23 00:08:04,024: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:04.030460348Z [2024-02-23 00:08:04,029: ERROR/ForkPoolWorker-2] [b92072a1-9029-4815-b20b-a037cce2a748] Failed to execute task Dag 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse.. 2024-02-23T00:08:04.030495519Z Traceback (most recent call last): 2024-02-23T00:08:04.030503487Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T00:08:04.030510497Z args.func(args) 2024-02-23T00:08:04.030517006Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T00:08:04.030523683Z return func(*args, **kwargs) 2024-02-23T00:08:04.030529415Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T00:08:04.030535258Z return f(*args, **kwargs) 2024-02-23T00:08:04.030540918Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T00:08:04.030547408Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T00:08:04.030553245Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T00:08:04.030559049Z raise AirflowException( 2024-02-23T00:08:04.030568496Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse. 2024-02-23T00:08:04.105432933Z [2024-02-23 00:08:04,104: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b92072a1-9029-4815-b20b-a037cce2a748] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b92072a1-9029-4815-b20b-a037cce2a748') 2024-02-23T00:08:04.105460656Z Traceback (most recent call last): 2024-02-23T00:08:04.105466371Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T00:08:04.105470806Z R = retval = fun(*args, **kwargs) 2024-02-23T00:08:04.105475252Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T00:08:04.105479425Z return self.run(*args, **kwargs) 2024-02-23T00:08:04.105484417Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T00:08:04.105489283Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T00:08:04.105498027Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T00:08:04.105503597Z raise AirflowException(msg) 2024-02-23T00:08:04.105508906Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b92072a1-9029-4815-b20b-a037cce2a748 2024-02-23T00:08:06.620361260Z [2024-02-23 00:08:06,619: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[489ca9be-98db-4ca5-b07f-0ee175ad6e8c] succeeded in 5.444286262999867s: None 2024-02-23T00:08:07.778379752Z [2024-02-23 00:08:07,778: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[78f7deeb-d612-4789-b411-3280ef3315fd] succeeded in 6.575888733999818s: None 2024-02-23T00:08:13.863093665Z [2024-02-23 00:08:13,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1075e675-ddff-4d39-9dc2-5fb13d248ebf] received 2024-02-23T00:08:13.871534156Z [2024-02-23 00:08:13,871: INFO/ForkPoolWorker-15] [1075e675-ddff-4d39-9dc2-5fb13d248ebf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:08:14.172528524Z [2024-02-23 00:08:14,169: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:15.092439742Z [2024-02-23 00:08:15,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2939256-08b2-4939-b982-7e14efdaadd6] received 2024-02-23T00:08:15.103771836Z [2024-02-23 00:08:15,103: INFO/ForkPoolWorker-16] [f2939256-08b2-4939-b982-7e14efdaadd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:08:15.386432734Z [2024-02-23 00:08:15,380: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:15.425628083Z [2024-02-23 00:08:15,425: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:08:15.429546492Z [2024-02-23 00:08:15,429: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:15.455133262Z [2024-02-23 00:08:15,454: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:08:15.456863896Z [2024-02-23 00:08:15,456: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:15.457821646Z [2024-02-23 00:08:15,456: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:15.458069995Z [2024-02-23 00:08:15,457: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:15.458184752Z [2024-02-23 00:08:15,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:08:15.458627809Z [2024-02-23 00:08:15,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:08:15.458755612Z [2024-02-23 00:08:15,458: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:15.467325652Z [2024-02-23 00:08:15,466: WARNING/ForkPoolWorker-15] Dag 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:15.468254544Z [2024-02-23 00:08:15,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:08:15.469084332Z [2024-02-23 00:08:15,468: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:08:15.472095509Z [2024-02-23 00:08:15,471: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:15.489172615Z [2024-02-23 00:08:15,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:08:15.491755236Z [2024-02-23 00:08:15,491: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:15.491933584Z [2024-02-23 00:08:15,491: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:15.492123861Z [2024-02-23 00:08:15,491: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:15.492191710Z [2024-02-23 00:08:15,492: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:08:15.492505680Z [2024-02-23 00:08:15,492: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:08:15.492631580Z [2024-02-23 00:08:15,492: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:15.496219785Z [2024-02-23 00:08:15,495: ERROR/ForkPoolWorker-15] [1075e675-ddff-4d39-9dc2-5fb13d248ebf] Failed to execute task Dag 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse.. 2024-02-23T00:08:15.496233056Z Traceback (most recent call last): 2024-02-23T00:08:15.496236996Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T00:08:15.496240874Z args.func(args) 2024-02-23T00:08:15.496244440Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T00:08:15.496248138Z return func(*args, **kwargs) 2024-02-23T00:08:15.496251223Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T00:08:15.496254447Z return f(*args, **kwargs) 2024-02-23T00:08:15.496257777Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T00:08:15.496260935Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T00:08:15.496264346Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T00:08:15.496267419Z raise AirflowException( 2024-02-23T00:08:15.496271187Z airflow.exceptions.AirflowException: Dag 'vim_status_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse. 2024-02-23T00:08:15.540879654Z [2024-02-23 00:08:15,540: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1075e675-ddff-4d39-9dc2-5fb13d248ebf] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1075e675-ddff-4d39-9dc2-5fb13d248ebf') 2024-02-23T00:08:15.540902679Z Traceback (most recent call last): 2024-02-23T00:08:15.540908877Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T00:08:15.540913509Z R = retval = fun(*args, **kwargs) 2024-02-23T00:08:15.540918053Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T00:08:15.540922519Z return self.run(*args, **kwargs) 2024-02-23T00:08:15.540927616Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T00:08:15.540932575Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T00:08:15.540937010Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T00:08:15.540942128Z raise AirflowException(msg) 2024-02-23T00:08:15.540947369Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1075e675-ddff-4d39-9dc2-5fb13d248ebf 2024-02-23T00:08:16.483620606Z [2024-02-23 00:08:16,483: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:08:16.486910715Z [2024-02-23 00:08:16,486: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:16.511803958Z [2024-02-23 00:08:16,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:08:16.513442906Z [2024-02-23 00:08:16,513: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:16.513604837Z [2024-02-23 00:08:16,513: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:16.513858697Z [2024-02-23 00:08:16,513: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:16.513996831Z [2024-02-23 00:08:16,513: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:08:16.514365787Z [2024-02-23 00:08:16,514: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:08:16.514488073Z [2024-02-23 00:08:16,514: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:16.522908697Z [2024-02-23 00:08:16,522: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:16.523862799Z [2024-02-23 00:08:16,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:08:16.524902034Z [2024-02-23 00:08:16,524: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:08:16.528217065Z [2024-02-23 00:08:16,527: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:08:16.553211847Z [2024-02-23 00:08:16,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:08:16.556239082Z [2024-02-23 00:08:16,555: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:08:16.556521146Z [2024-02-23 00:08:16,556: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:08:16.556919217Z [2024-02-23 00:08:16,556: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:08:16.557101890Z [2024-02-23 00:08:16,556: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:08:16.557676295Z [2024-02-23 00:08:16,557: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:08:16.558008562Z [2024-02-23 00:08:16,557: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:08:16.565157805Z [2024-02-23 00:08:16,564: ERROR/ForkPoolWorker-16] [f2939256-08b2-4939-b982-7e14efdaadd6] Failed to execute task Dag 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse.. 2024-02-23T00:08:16.565210505Z Traceback (most recent call last): 2024-02-23T00:08:16.565219927Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T00:08:16.565227760Z args.func(args) 2024-02-23T00:08:16.565235877Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T00:08:16.565243687Z return func(*args, **kwargs) 2024-02-23T00:08:16.565251760Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T00:08:16.565259678Z return f(*args, **kwargs) 2024-02-23T00:08:16.565267210Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T00:08:16.565274476Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T00:08:16.565281727Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T00:08:16.565289344Z raise AirflowException( 2024-02-23T00:08:16.565297443Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_849dbe84-3929-40dd-86bc-883acccf1b48' could not be found; either it does not exist or it failed to parse. 2024-02-23T00:08:16.605332344Z [2024-02-23 00:08:16,604: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2939256-08b2-4939-b982-7e14efdaadd6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2939256-08b2-4939-b982-7e14efdaadd6') 2024-02-23T00:08:16.605349113Z Traceback (most recent call last): 2024-02-23T00:08:16.605352974Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T00:08:16.605355875Z R = retval = fun(*args, **kwargs) 2024-02-23T00:08:16.605358749Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T00:08:16.605361760Z return self.run(*args, **kwargs) 2024-02-23T00:08:16.605365149Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T00:08:16.605368887Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T00:08:16.605372480Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T00:08:16.605375894Z raise AirflowException(msg) 2024-02-23T00:08:16.605381721Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f2939256-08b2-4939-b982-7e14efdaadd6 2024-02-23T00:09:00.449026425Z [2024-02-23 00:09:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[579e7d26-5bde-4397-9e1c-c6671d829d0e] received 2024-02-23T00:09:00.450801677Z [2024-02-23 00:09:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a6ac095-74be-44c9-9167-3a57d7453614] received 2024-02-23T00:09:00.452360873Z [2024-02-23 00:09:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e593e6a9-c94f-4ac8-a435-291847d0f4f7] received 2024-02-23T00:09:00.456902537Z [2024-02-23 00:09:00,456: INFO/ForkPoolWorker-15] [579e7d26-5bde-4397-9e1c-c6671d829d0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:09:00.458779431Z [2024-02-23 00:09:00,458: INFO/ForkPoolWorker-16] [5a6ac095-74be-44c9-9167-3a57d7453614] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:09:00.464651678Z [2024-02-23 00:09:00,463: INFO/ForkPoolWorker-1] [e593e6a9-c94f-4ac8-a435-291847d0f4f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:09:00.766345996Z [2024-02-23 00:09:00,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:09:00.777496830Z [2024-02-23 00:09:00,774: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:09:00.785189424Z [2024-02-23 00:09:00,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:09:00.939185794Z [2024-02-23 00:09:00,938: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:09:00.944647678Z [2024-02-23 00:09:00,944: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:09:00.971261969Z [2024-02-23 00:09:00,971: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:09:00.972828361Z [2024-02-23 00:09:00,972: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:09:00.973058223Z [2024-02-23 00:09:00,972: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:09:00.973239136Z [2024-02-23 00:09:00,973: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:09:00.973581732Z [2024-02-23 00:09:00,973: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:09:01.063860683Z [2024-02-23 00:09:01,063: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:09:01.698666552Z [2024-02-23 00:09:01,698: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[579e7d26-5bde-4397-9e1c-c6671d829d0e] succeeded in 1.2481573990003199s: None 2024-02-23T00:09:02.024350344Z [2024-02-23 00:09:02,023: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:09:02.027830198Z [2024-02-23 00:09:02,027: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:09:02.047090789Z [2024-02-23 00:09:02,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:09:02.048473380Z [2024-02-23 00:09:02,048: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:09:02.048647265Z [2024-02-23 00:09:02,048: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:09:02.048820104Z [2024-02-23 00:09:02,048: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:09:02.048951384Z [2024-02-23 00:09:02,048: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:09:02.049195969Z [2024-02-23 00:09:02,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:09:02.049252685Z [2024-02-23 00:09:02,049: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:09:02.138271643Z [2024-02-23 00:09:02,137: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:09:02.141779474Z [2024-02-23 00:09:02,141: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:09:02.162940011Z [2024-02-23 00:09:02,162: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:09:02.174713858Z [2024-02-23 00:09:02,174: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:09:02.178330431Z [2024-02-23 00:09:02,177: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:09:02.178513508Z [2024-02-23 00:09:02,178: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:09:02.178990822Z [2024-02-23 00:09:02,178: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:09:02.179268602Z [2024-02-23 00:09:02,179: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:09:02.179874835Z [2024-02-23 00:09:02,179: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:09:02.180185199Z [2024-02-23 00:09:02,179: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:09:02.272306897Z [2024-02-23 00:09:02,271: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:09:03.883635128Z [2024-02-23 00:09:03,882: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e593e6a9-c94f-4ac8-a435-291847d0f4f7] succeeded in 3.4262287060000745s: None 2024-02-23T00:09:04.280652383Z [2024-02-23 00:09:04,280: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a6ac095-74be-44c9-9167-3a57d7453614] succeeded in 3.827027266999721s: None 2024-02-23T00:10:01.314438037Z [2024-02-23 00:10:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94b17639-cfbb-41ac-8f58-828aab260ee1] received 2024-02-23T00:10:01.323088170Z [2024-02-23 00:10:01,322: INFO/ForkPoolWorker-15] [94b17639-cfbb-41ac-8f58-828aab260ee1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:10:01.331639684Z [2024-02-23 00:10:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96fda56b-0104-4bc6-a473-229e45e688e9] received 2024-02-23T00:10:01.334517602Z [2024-02-23 00:10:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73f5f42c-4cbf-4231-9178-396e1e934b70] received 2024-02-23T00:10:01.341166163Z [2024-02-23 00:10:01,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d48f0eaa-dfd4-44d9-84ce-866a29e29a8e] received 2024-02-23T00:10:01.342105699Z [2024-02-23 00:10:01,341: INFO/ForkPoolWorker-1] [73f5f42c-4cbf-4231-9178-396e1e934b70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:10:01.346618826Z [2024-02-23 00:10:01,345: INFO/ForkPoolWorker-16] [96fda56b-0104-4bc6-a473-229e45e688e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:10:01.350554587Z [2024-02-23 00:10:01,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59097abd-239b-49fc-afd5-6972a7495fb9] received 2024-02-23T00:10:01.362097571Z [2024-02-23 00:10:01,361: INFO/ForkPoolWorker-3] [59097abd-239b-49fc-afd5-6972a7495fb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:10:01.364838278Z [2024-02-23 00:10:01,364: INFO/ForkPoolWorker-2] [d48f0eaa-dfd4-44d9-84ce-866a29e29a8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:10:01.668444512Z [2024-02-23 00:10:01,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:10:01.738062890Z [2024-02-23 00:10:01,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:10:01.754885113Z [2024-02-23 00:10:01,750: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:10:01.975356105Z [2024-02-23 00:10:01,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:10:01.980212306Z [2024-02-23 00:10:01,972: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:10:02.288564229Z [2024-02-23 00:10:02,288: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T00:10:02.293086455Z [2024-02-23 00:10:02,292: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:02.348049389Z [2024-02-23 00:10:02,347: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:02.354916337Z [2024-02-23 00:10:02,354: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:10:02.359883074Z [2024-02-23 00:10:02,359: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:10:02.360228040Z [2024-02-23 00:10:02,359: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:10:02.361380518Z [2024-02-23 00:10:02,360: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T00:10:02.361837509Z [2024-02-23 00:10:02,361: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:10:02.492178992Z [2024-02-23 00:10:02,491: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:02.928350130Z [2024-02-23 00:10:02,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96fda56b-0104-4bc6-a473-229e45e688e9] succeeded in 1.5941285690000768s: None 2024-02-23T00:10:03.219567448Z [2024-02-23 00:10:03,219: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:10:03.222983133Z [2024-02-23 00:10:03,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:03.245601658Z [2024-02-23 00:10:03,245: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[59097abd-239b-49fc-afd5-6972a7495fb9] succeeded in 1.8906161959998826s: None 2024-02-23T00:10:03.266666941Z [2024-02-23 00:10:03,266: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:10:03.270126563Z [2024-02-23 00:10:03,269: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:10:03.270201601Z [2024-02-23 00:10:03,270: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:10:03.270955505Z [2024-02-23 00:10:03,270: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:10:03.271157595Z [2024-02-23 00:10:03,270: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:10:03.273083348Z [2024-02-23 00:10:03,272: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:10:03.273201859Z [2024-02-23 00:10:03,273: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:10:03.357681803Z [2024-02-23 00:10:03,357: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:10:03.361218603Z [2024-02-23 00:10:03,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:03.385357796Z [2024-02-23 00:10:03,385: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:10:03.386897345Z [2024-02-23 00:10:03,386: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:10:03.387076829Z [2024-02-23 00:10:03,386: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:10:03.387306830Z [2024-02-23 00:10:03,387: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:10:03.387441037Z [2024-02-23 00:10:03,387: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:10:03.387833713Z [2024-02-23 00:10:03,387: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:10:03.387971010Z [2024-02-23 00:10:03,387: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:10:03.410437736Z [2024-02-23 00:10:03,410: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:10:03.413861867Z [2024-02-23 00:10:03,413: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:03.425136004Z [2024-02-23 00:10:03,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:03.449828413Z [2024-02-23 00:10:03,449: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:10:03.451721494Z [2024-02-23 00:10:03,451: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:10:03.451893518Z [2024-02-23 00:10:03,451: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:10:03.452188966Z [2024-02-23 00:10:03,451: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:10:03.452339941Z [2024-02-23 00:10:03,452: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:10:03.452756694Z [2024-02-23 00:10:03,452: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:10:03.452991887Z [2024-02-23 00:10:03,452: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:10:03.541937258Z [2024-02-23 00:10:03,541: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:03.542160524Z [2024-02-23 00:10:03,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:04.268529624Z [2024-02-23 00:10:04,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94b17639-cfbb-41ac-8f58-828aab260ee1] succeeded in 2.951712257000054s: None 2024-02-23T00:10:05.079061844Z [2024-02-23 00:10:05,078: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73f5f42c-4cbf-4231-9178-396e1e934b70] succeeded in 3.742488635999962s: None 2024-02-23T00:10:05.265987668Z [2024-02-23 00:10:05,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a6028e0-06ef-4874-bd5a-e000c17e9b32] received 2024-02-23T00:10:05.275939437Z [2024-02-23 00:10:05,275: INFO/ForkPoolWorker-15] [7a6028e0-06ef-4874-bd5a-e000c17e9b32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:10:05.620783191Z [2024-02-23 00:10:05,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:10:05.688303441Z [2024-02-23 00:10:05,687: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d48f0eaa-dfd4-44d9-84ce-866a29e29a8e] succeeded in 4.34110425200015s: None 2024-02-23T00:10:06.776417438Z [2024-02-23 00:10:06,776: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:10:06.780109110Z [2024-02-23 00:10:06,779: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:06.798764512Z [2024-02-23 00:10:06,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:10:06.801079442Z [2024-02-23 00:10:06,800: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:10:06.801123489Z [2024-02-23 00:10:06,800: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:10:06.801132065Z [2024-02-23 00:10:06,800: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:10:06.801137787Z [2024-02-23 00:10:06,800: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:10:06.801489360Z [2024-02-23 00:10:06,801: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:10:06.801608609Z [2024-02-23 00:10:06,801: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:10:06.907771584Z [2024-02-23 00:10:06,907: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:07.653500610Z [2024-02-23 00:10:07,652: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a6028e0-06ef-4874-bd5a-e000c17e9b32] succeeded in 2.3849702940001407s: None 2024-02-23T00:10:07.673366180Z [2024-02-23 00:10:07,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[376a3db1-82b2-431a-b099-76eb971efd63] received 2024-02-23T00:10:07.682419986Z [2024-02-23 00:10:07,682: INFO/ForkPoolWorker-15] [376a3db1-82b2-431a-b099-76eb971efd63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:10:08.088543683Z [2024-02-23 00:10:08,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:10:09.263949870Z [2024-02-23 00:10:09,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:10:09.268680266Z [2024-02-23 00:10:09,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:09.294007940Z [2024-02-23 00:10:09,293: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:10:09.295541054Z [2024-02-23 00:10:09,295: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:10:09.295679013Z [2024-02-23 00:10:09,295: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:10:09.295913616Z [2024-02-23 00:10:09,295: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:10:09.296249301Z [2024-02-23 00:10:09,296: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:10:09.296787936Z [2024-02-23 00:10:09,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:10:09.296991432Z [2024-02-23 00:10:09,296: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:10:09.399444564Z [2024-02-23 00:10:09,399: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:09.986440620Z [2024-02-23 00:10:09,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[376a3db1-82b2-431a-b099-76eb971efd63] succeeded in 2.310323559999688s: None 2024-02-23T00:10:10.354535930Z [2024-02-23 00:10:10,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[201501c9-b803-401d-92d4-81cdb11d91a7] received 2024-02-23T00:10:10.363504793Z [2024-02-23 00:10:10,363: INFO/ForkPoolWorker-15] [201501c9-b803-401d-92d4-81cdb11d91a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:10:10.715337581Z [2024-02-23 00:10:10,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:10:11.868631916Z [2024-02-23 00:10:11,868: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:10:11.872239209Z [2024-02-23 00:10:11,871: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:10:11.902911331Z [2024-02-23 00:10:11,902: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:10:11.905711582Z [2024-02-23 00:10:11,905: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:10:11.905945671Z [2024-02-23 00:10:11,905: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:10:11.906155118Z [2024-02-23 00:10:11,905: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:10:11.906265559Z [2024-02-23 00:10:11,906: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:10:11.906642518Z [2024-02-23 00:10:11,906: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:10:11.906655629Z [2024-02-23 00:10:11,906: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:10:12.015359675Z [2024-02-23 00:10:12,014: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:10:12.612042718Z [2024-02-23 00:10:12,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[201501c9-b803-401d-92d4-81cdb11d91a7] succeeded in 2.254797836999842s: None 2024-02-23T00:11:01.250390342Z [2024-02-23 00:11:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93f06b7e-8b50-4512-8831-31ce3472bc16] received 2024-02-23T00:11:01.254416174Z [2024-02-23 00:11:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bcf40d1-7262-4e3a-96be-11dac908957b] received 2024-02-23T00:11:01.263671433Z [2024-02-23 00:11:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7de7c534-33b9-46f7-a403-b88c4e0b393e] received 2024-02-23T00:11:01.268779464Z [2024-02-23 00:11:01,268: INFO/ForkPoolWorker-16] [3bcf40d1-7262-4e3a-96be-11dac908957b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:11:01.271541887Z [2024-02-23 00:11:01,271: INFO/ForkPoolWorker-15] [93f06b7e-8b50-4512-8831-31ce3472bc16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:11:01.275648516Z [2024-02-23 00:11:01,275: INFO/ForkPoolWorker-1] [7de7c534-33b9-46f7-a403-b88c4e0b393e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:11:01.564001848Z [2024-02-23 00:11:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:11:01.600036980Z [2024-02-23 00:11:01,596: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:11:01.614655326Z [2024-02-23 00:11:01,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:11:01.802751146Z [2024-02-23 00:11:01,801: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:11:01.807177091Z [2024-02-23 00:11:01,806: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:11:01.836676402Z [2024-02-23 00:11:01,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:11:01.839511933Z [2024-02-23 00:11:01,839: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:11:01.840014491Z [2024-02-23 00:11:01,839: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:11:01.840151720Z [2024-02-23 00:11:01,840: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:11:01.840963498Z [2024-02-23 00:11:01,840: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:11:01.948316420Z [2024-02-23 00:11:01,947: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:11:02.623570272Z [2024-02-23 00:11:02,623: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7de7c534-33b9-46f7-a403-b88c4e0b393e] succeeded in 1.3547407719997864s: None 2024-02-23T00:11:02.754514652Z [2024-02-23 00:11:02,754: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:11:02.759961820Z [2024-02-23 00:11:02,759: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:11:02.785210561Z [2024-02-23 00:11:02,784: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:11:02.786904911Z [2024-02-23 00:11:02,786: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:11:02.787146925Z [2024-02-23 00:11:02,786: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:11:02.787444579Z [2024-02-23 00:11:02,787: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:11:02.787779553Z [2024-02-23 00:11:02,787: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:11:02.788221520Z [2024-02-23 00:11:02,788: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:11:02.788852920Z [2024-02-23 00:11:02,788: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:11:02.878363084Z [2024-02-23 00:11:02,877: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:11:02.881859045Z [2024-02-23 00:11:02,881: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:11:02.906156441Z [2024-02-23 00:11:02,905: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:11:02.911903142Z [2024-02-23 00:11:02,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:11:02.913228282Z [2024-02-23 00:11:02,912: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:11:02.913261562Z [2024-02-23 00:11:02,913: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:11:02.913430958Z [2024-02-23 00:11:02,913: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:11:02.913569563Z [2024-02-23 00:11:02,913: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:11:02.913906402Z [2024-02-23 00:11:02,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:11:02.913917658Z [2024-02-23 00:11:02,913: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:11:03.048685786Z [2024-02-23 00:11:03,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:11:05.391770416Z [2024-02-23 00:11:05,391: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bcf40d1-7262-4e3a-96be-11dac908957b] succeeded in 4.136102296999979s: None 2024-02-23T00:11:07.308740911Z [2024-02-23 00:11:07,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93f06b7e-8b50-4512-8831-31ce3472bc16] succeeded in 6.05230951700014s: None 2024-02-23T00:12:00.577295470Z [2024-02-23 00:12:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5371eafd-2654-40eb-a263-4e5b6c9b6a75] received 2024-02-23T00:12:00.580969029Z [2024-02-23 00:12:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1060fcbc-c977-497e-a08d-cee822f9e6d1] received 2024-02-23T00:12:00.593178065Z [2024-02-23 00:12:00,592: INFO/ForkPoolWorker-15] [5371eafd-2654-40eb-a263-4e5b6c9b6a75] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:12:00.594180556Z [2024-02-23 00:12:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b77d6e97-3abe-47ea-8f2a-9200346ae0b8] received 2024-02-23T00:12:00.597988353Z [2024-02-23 00:12:00,597: INFO/ForkPoolWorker-16] [1060fcbc-c977-497e-a08d-cee822f9e6d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:12:00.603774871Z [2024-02-23 00:12:00,603: INFO/ForkPoolWorker-1] [b77d6e97-3abe-47ea-8f2a-9200346ae0b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:12:00.604226864Z [2024-02-23 00:12:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fde265cf-d871-4720-a7f7-1f432878b2b6] received 2024-02-23T00:12:00.620489509Z [2024-02-23 00:12:00,620: INFO/ForkPoolWorker-2] [fde265cf-d871-4720-a7f7-1f432878b2b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:12:00.952137978Z [2024-02-23 00:12:00,949: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:12:00.960542603Z [2024-02-23 00:12:00,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:12:00.979281291Z [2024-02-23 00:12:00,976: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:12:01.077150744Z [2024-02-23 00:12:01,073: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:12:01.243163444Z [2024-02-23 00:12:01,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:12:01.274570911Z [2024-02-23 00:12:01,274: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:12:01.280525859Z [2024-02-23 00:12:01,280: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:12:01.315862055Z [2024-02-23 00:12:01,315: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:12:01.319342016Z [2024-02-23 00:12:01,319: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:12:01.319602265Z [2024-02-23 00:12:01,319: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:12:01.319743745Z [2024-02-23 00:12:01,319: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:12:01.320042158Z [2024-02-23 00:12:01,319: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:12:01.458087008Z [2024-02-23 00:12:01,457: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:12:01.944356509Z [2024-02-23 00:12:01,943: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5371eafd-2654-40eb-a263-4e5b6c9b6a75] succeeded in 1.3607267369998226s: None 2024-02-23T00:12:02.218444958Z [2024-02-23 00:12:02,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b77d6e97-3abe-47ea-8f2a-9200346ae0b8] succeeded in 1.6214509989999897s: None 2024-02-23T00:12:02.364407906Z [2024-02-23 00:12:02,363: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:12:02.368979342Z [2024-02-23 00:12:02,368: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:12:02.397664175Z [2024-02-23 00:12:02,397: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:12:02.399423915Z [2024-02-23 00:12:02,399: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:12:02.399624006Z [2024-02-23 00:12:02,399: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:12:02.399779325Z [2024-02-23 00:12:02,399: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:12:02.399866748Z [2024-02-23 00:12:02,399: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:12:02.400683350Z [2024-02-23 00:12:02,400: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:12:02.400784650Z [2024-02-23 00:12:02,400: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:12:02.525652364Z [2024-02-23 00:12:02,525: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:12:02.597912849Z [2024-02-23 00:12:02,597: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:12:02.601258576Z [2024-02-23 00:12:02,600: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:12:02.623648567Z [2024-02-23 00:12:02,623: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:12:02.624979659Z [2024-02-23 00:12:02,624: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:12:02.624991402Z [2024-02-23 00:12:02,624: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:12:02.625090256Z [2024-02-23 00:12:02,624: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:12:02.625128385Z [2024-02-23 00:12:02,625: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:12:02.625365497Z [2024-02-23 00:12:02,625: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:12:02.625403846Z [2024-02-23 00:12:02,625: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:12:02.773261025Z [2024-02-23 00:12:02,772: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:12:04.416735242Z [2024-02-23 00:12:04,416: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1060fcbc-c977-497e-a08d-cee822f9e6d1] succeeded in 3.8337827420000394s: None 2024-02-23T00:12:04.881908568Z [2024-02-23 00:12:04,881: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fde265cf-d871-4720-a7f7-1f432878b2b6] succeeded in 4.275891560999753s: None 2024-02-23T00:13:00.974673003Z [2024-02-23 00:13:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[192f2b3a-1d82-4703-a558-1a5bb8506628] received 2024-02-23T00:13:00.980783459Z [2024-02-23 00:13:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0306d933-78d6-4d25-baa6-844b4a5a16ea] received 2024-02-23T00:13:00.985128207Z [2024-02-23 00:13:00,984: INFO/ForkPoolWorker-15] [192f2b3a-1d82-4703-a558-1a5bb8506628] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:13:00.989208253Z [2024-02-23 00:13:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f400302-adec-40d1-a034-8b6cf28707cb] received 2024-02-23T00:13:00.991870858Z [2024-02-23 00:13:00,990: INFO/ForkPoolWorker-16] [0306d933-78d6-4d25-baa6-844b4a5a16ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:13:01.003995657Z [2024-02-23 00:13:01,003: INFO/ForkPoolWorker-1] [5f400302-adec-40d1-a034-8b6cf28707cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:13:01.283134306Z [2024-02-23 00:13:01,279: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:13:01.287490200Z [2024-02-23 00:13:01,284: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:13:01.302250769Z [2024-02-23 00:13:01,298: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:13:01.447329142Z [2024-02-23 00:13:01,446: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:13:01.451641120Z [2024-02-23 00:13:01,451: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:13:01.482621811Z [2024-02-23 00:13:01,482: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:13:01.483792061Z [2024-02-23 00:13:01,483: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:13:01.483925537Z [2024-02-23 00:13:01,483: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:13:01.483996771Z [2024-02-23 00:13:01,483: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:13:01.484323294Z [2024-02-23 00:13:01,484: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:13:01.577074331Z [2024-02-23 00:13:01,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:13:02.305576239Z [2024-02-23 00:13:02,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0306d933-78d6-4d25-baa6-844b4a5a16ea] succeeded in 1.3232459809996726s: None 2024-02-23T00:13:02.566461946Z [2024-02-23 00:13:02,566: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:13:02.569986585Z [2024-02-23 00:13:02,569: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:13:02.596875768Z [2024-02-23 00:13:02,596: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:13:02.598779552Z [2024-02-23 00:13:02,598: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:13:02.598939104Z [2024-02-23 00:13:02,598: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:13:02.599370479Z [2024-02-23 00:13:02,598: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:13:02.599628867Z [2024-02-23 00:13:02,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:13:02.600127309Z [2024-02-23 00:13:02,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:13:02.600252501Z [2024-02-23 00:13:02,600: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:13:02.611073156Z [2024-02-23 00:13:02,610: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:13:02.615072292Z [2024-02-23 00:13:02,614: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:13:02.639294716Z [2024-02-23 00:13:02,639: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:13:02.640929351Z [2024-02-23 00:13:02,640: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:13:02.640952397Z [2024-02-23 00:13:02,640: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:13:02.641236143Z [2024-02-23 00:13:02,641: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:13:02.641307744Z [2024-02-23 00:13:02,641: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:13:02.641631100Z [2024-02-23 00:13:02,641: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:13:02.641756549Z [2024-02-23 00:13:02,641: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:13:02.693685063Z [2024-02-23 00:13:02,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:13:02.723031632Z [2024-02-23 00:13:02,722: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:13:04.733940103Z [2024-02-23 00:13:04,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[192f2b3a-1d82-4703-a558-1a5bb8506628] succeeded in 3.756992412999807s: None 2024-02-23T00:13:05.232637440Z [2024-02-23 00:13:05,231: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f400302-adec-40d1-a034-8b6cf28707cb] succeeded in 4.239657399999942s: None 2024-02-23T00:14:00.339269405Z [2024-02-23 00:14:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab33838b-5f5a-4308-bb30-bf55da87cd47] received 2024-02-23T00:14:00.347107009Z [2024-02-23 00:14:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12710be3-f267-4c41-a21e-4ffac08dabe1] received 2024-02-23T00:14:00.356837014Z [2024-02-23 00:14:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[373b5884-a9a9-4aa5-8432-6bb09085d137] received 2024-02-23T00:14:00.361929465Z [2024-02-23 00:14:00,361: INFO/ForkPoolWorker-15] [ab33838b-5f5a-4308-bb30-bf55da87cd47] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:14:00.362471753Z [2024-02-23 00:14:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[057810bb-d88f-48f0-82c7-9eac6dbfc69a] received 2024-02-23T00:14:00.372420787Z [2024-02-23 00:14:00,372: INFO/ForkPoolWorker-2] [057810bb-d88f-48f0-82c7-9eac6dbfc69a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:14:00.372923805Z [2024-02-23 00:14:00,372: INFO/ForkPoolWorker-16] [12710be3-f267-4c41-a21e-4ffac08dabe1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:14:00.396051126Z [2024-02-23 00:14:00,395: INFO/ForkPoolWorker-1] [373b5884-a9a9-4aa5-8432-6bb09085d137] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:14:00.772440086Z [2024-02-23 00:14:00,768: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:14:00.944025181Z [2024-02-23 00:14:00,940: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:14:00.983055434Z [2024-02-23 00:14:00,979: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:14:01.093515679Z [2024-02-23 00:14:01,090: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:14:01.160599897Z [2024-02-23 00:14:01,160: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:14:01.164592636Z [2024-02-23 00:14:01,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:14:01.216943897Z [2024-02-23 00:14:01,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:14:01.220090717Z [2024-02-23 00:14:01,219: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:14:01.220232081Z [2024-02-23 00:14:01,220: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:14:01.220345729Z [2024-02-23 00:14:01,220: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:14:01.220685230Z [2024-02-23 00:14:01,220: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:14:01.290841244Z [2024-02-23 00:14:01,290: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:14:01.314072813Z [2024-02-23 00:14:01,313: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:14:01.927497186Z [2024-02-23 00:14:01,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab33838b-5f5a-4308-bb30-bf55da87cd47] succeeded in 1.574255020000237s: None 2024-02-23T00:14:01.943534541Z [2024-02-23 00:14:01,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12710be3-f267-4c41-a21e-4ffac08dabe1] succeeded in 1.5915317399999367s: None 2024-02-23T00:14:02.533254820Z [2024-02-23 00:14:02,532: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:14:02.536706580Z [2024-02-23 00:14:02,536: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:14:02.553797686Z [2024-02-23 00:14:02,553: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:14:02.555182140Z [2024-02-23 00:14:02,554: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:14:02.555196320Z [2024-02-23 00:14:02,555: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:14:02.555317236Z [2024-02-23 00:14:02,555: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:14:02.555324637Z [2024-02-23 00:14:02,555: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:14:02.555633398Z [2024-02-23 00:14:02,555: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:14:02.555643013Z [2024-02-23 00:14:02,555: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:14:02.558091500Z [2024-02-23 00:14:02,557: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:14:02.561644419Z [2024-02-23 00:14:02,561: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:14:02.596356975Z [2024-02-23 00:14:02,596: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:14:02.598306541Z [2024-02-23 00:14:02,598: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:14:02.598528777Z [2024-02-23 00:14:02,598: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:14:02.598783671Z [2024-02-23 00:14:02,598: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:14:02.598998494Z [2024-02-23 00:14:02,598: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:14:02.599355530Z [2024-02-23 00:14:02,599: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:14:02.599525959Z [2024-02-23 00:14:02,599: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:14:02.649927307Z [2024-02-23 00:14:02,649: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:14:02.706529962Z [2024-02-23 00:14:02,706: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:14:04.489660468Z [2024-02-23 00:14:04,489: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[373b5884-a9a9-4aa5-8432-6bb09085d137] succeeded in 4.124803748999966s: None 2024-02-23T00:14:05.660925083Z [2024-02-23 00:14:05,660: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[057810bb-d88f-48f0-82c7-9eac6dbfc69a] succeeded in 5.296134574999996s: None 2024-02-23T00:15:00.340124317Z [2024-02-23 00:15:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97bb7392-88b5-469c-b7fe-2ea221e4d6b0] received 2024-02-23T00:15:00.342212410Z [2024-02-23 00:15:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59966e7c-6a59-41cd-8984-02c707c7b53e] received 2024-02-23T00:15:00.348134935Z [2024-02-23 00:15:00,347: INFO/ForkPoolWorker-16] [59966e7c-6a59-41cd-8984-02c707c7b53e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:15:00.348544591Z [2024-02-23 00:15:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[811a0506-ad4e-42c0-98b3-63b16a0ee471] received 2024-02-23T00:15:00.352558234Z [2024-02-23 00:15:00,352: INFO/ForkPoolWorker-15] [97bb7392-88b5-469c-b7fe-2ea221e4d6b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:15:00.353600802Z [2024-02-23 00:15:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa669dde-4a09-48d5-97bb-99c0dda6fbdf] received 2024-02-23T00:15:00.359571844Z [2024-02-23 00:15:00,359: INFO/ForkPoolWorker-1] [811a0506-ad4e-42c0-98b3-63b16a0ee471] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:15:00.364192034Z [2024-02-23 00:15:00,363: INFO/ForkPoolWorker-2] [aa669dde-4a09-48d5-97bb-99c0dda6fbdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:15:00.659122753Z [2024-02-23 00:15:00,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:15:00.659474596Z [2024-02-23 00:15:00,656: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:15:00.670672943Z [2024-02-23 00:15:00,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:15:00.725055468Z [2024-02-23 00:15:00,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:15:00.883202382Z [2024-02-23 00:15:00,882: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:15:00.888339946Z [2024-02-23 00:15:00,887: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:00.928338642Z [2024-02-23 00:15:00,928: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:15:00.932560330Z [2024-02-23 00:15:00,932: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:15:00.932620528Z [2024-02-23 00:15:00,932: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:15:00.932625569Z [2024-02-23 00:15:00,932: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:15:00.934256741Z [2024-02-23 00:15:00,934: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:15:01.085187761Z [2024-02-23 00:15:01,083: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:01.924996217Z [2024-02-23 00:15:01,922: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59966e7c-6a59-41cd-8984-02c707c7b53e] succeeded in 1.5789865840001767s: None 2024-02-23T00:15:02.129567627Z [2024-02-23 00:15:02,129: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:15:02.133117653Z [2024-02-23 00:15:02,132: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:02.200643311Z [2024-02-23 00:15:02,200: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:15:02.202577026Z [2024-02-23 00:15:02,202: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:15:02.202759185Z [2024-02-23 00:15:02,202: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:15:02.203078196Z [2024-02-23 00:15:02,202: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:15:02.203239228Z [2024-02-23 00:15:02,203: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:15:02.203654962Z [2024-02-23 00:15:02,203: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:15:02.203817226Z [2024-02-23 00:15:02,203: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:15:02.278752466Z [2024-02-23 00:15:02,278: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:15:02.282784335Z [2024-02-23 00:15:02,282: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:02.312093497Z [2024-02-23 00:15:02,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:15:02.314350065Z [2024-02-23 00:15:02,313: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:15:02.314658103Z [2024-02-23 00:15:02,314: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:15:02.315275582Z [2024-02-23 00:15:02,314: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:15:02.315590747Z [2024-02-23 00:15:02,315: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:15:02.316312123Z [2024-02-23 00:15:02,316: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:15:02.316708832Z [2024-02-23 00:15:02,316: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:15:02.422423068Z [2024-02-23 00:15:02,422: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:02.474188392Z [2024-02-23 00:15:02,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:02.505995950Z [2024-02-23 00:15:02,505: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:15:02.512118477Z [2024-02-23 00:15:02,511: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:02.567613949Z [2024-02-23 00:15:02,567: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:15:02.575607890Z [2024-02-23 00:15:02,575: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:15:02.575628504Z [2024-02-23 00:15:02,575: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:15:02.575683983Z [2024-02-23 00:15:02,575: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:15:02.575775991Z [2024-02-23 00:15:02,575: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:15:02.576124454Z [2024-02-23 00:15:02,575: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:15:02.576198658Z [2024-02-23 00:15:02,576: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:15:02.687363389Z [2024-02-23 00:15:02,687: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:03.371181584Z [2024-02-23 00:15:03,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97bb7392-88b5-469c-b7fe-2ea221e4d6b0] succeeded in 3.0276127679999263s: None 2024-02-23T00:15:03.688483081Z [2024-02-23 00:15:03,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43ed1eed-a20a-4007-a1e6-1bdc349e149b] received 2024-02-23T00:15:03.697609640Z [2024-02-23 00:15:03,697: INFO/ForkPoolWorker-15] [43ed1eed-a20a-4007-a1e6-1bdc349e149b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:15:03.999556931Z [2024-02-23 00:15:03,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:15:04.317154480Z [2024-02-23 00:15:04,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[811a0506-ad4e-42c0-98b3-63b16a0ee471] succeeded in 3.964471897999829s: None 2024-02-23T00:15:04.856389364Z [2024-02-23 00:15:04,855: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aa669dde-4a09-48d5-97bb-99c0dda6fbdf] succeeded in 4.5004199320001135s: None 2024-02-23T00:15:05.379966747Z [2024-02-23 00:15:05,373: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:15:05.379991530Z [2024-02-23 00:15:05,377: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:05.413592744Z [2024-02-23 00:15:05,411: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:15:05.413601855Z [2024-02-23 00:15:05,412: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:15:05.413607063Z [2024-02-23 00:15:05,413: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:15:05.413611151Z [2024-02-23 00:15:05,413: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:15:05.413615363Z [2024-02-23 00:15:05,413: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:15:05.413618622Z [2024-02-23 00:15:05,413: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:15:05.413621863Z [2024-02-23 00:15:05,413: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:15:05.499521815Z [2024-02-23 00:15:05,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:06.269706396Z [2024-02-23 00:15:06,269: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43ed1eed-a20a-4007-a1e6-1bdc349e149b] succeeded in 2.579227854999772s: None 2024-02-23T00:15:06.551844381Z [2024-02-23 00:15:06,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[669e6d9a-cb20-4bfd-919b-236d8b21a905] received 2024-02-23T00:15:06.561750612Z [2024-02-23 00:15:06,561: INFO/ForkPoolWorker-15] [669e6d9a-cb20-4bfd-919b-236d8b21a905] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:15:06.831704555Z [2024-02-23 00:15:06,828: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:15:07.968679472Z [2024-02-23 00:15:07,968: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:15:07.972376089Z [2024-02-23 00:15:07,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:07.989519740Z [2024-02-23 00:15:07,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:15:07.990858982Z [2024-02-23 00:15:07,990: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:15:07.990877451Z [2024-02-23 00:15:07,990: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:15:07.991202230Z [2024-02-23 00:15:07,991: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:15:07.991315470Z [2024-02-23 00:15:07,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:15:07.991819441Z [2024-02-23 00:15:07,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:15:07.991969915Z [2024-02-23 00:15:07,991: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:15:08.087123525Z [2024-02-23 00:15:08,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:08.611252196Z [2024-02-23 00:15:08,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[669e6d9a-cb20-4bfd-919b-236d8b21a905] succeeded in 2.055966783999793s: None 2024-02-23T00:15:08.900755415Z [2024-02-23 00:15:08,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52e61165-1914-4fdb-859c-667c4a234ae7] received 2024-02-23T00:15:08.908796372Z [2024-02-23 00:15:08,908: INFO/ForkPoolWorker-15] [52e61165-1914-4fdb-859c-667c4a234ae7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:15:09.200498652Z [2024-02-23 00:15:09,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:15:10.326629661Z [2024-02-23 00:15:10,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:15:10.330125226Z [2024-02-23 00:15:10,329: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:15:10.355962817Z [2024-02-23 00:15:10,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:15:10.357382886Z [2024-02-23 00:15:10,357: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:15:10.357395221Z [2024-02-23 00:15:10,357: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:15:10.357514886Z [2024-02-23 00:15:10,357: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:15:10.357539736Z [2024-02-23 00:15:10,357: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:15:10.357748443Z [2024-02-23 00:15:10,357: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:15:10.357759424Z [2024-02-23 00:15:10,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:15:10.463643327Z [2024-02-23 00:15:10,463: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:15:11.061083881Z [2024-02-23 00:15:11,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52e61165-1914-4fdb-859c-667c4a234ae7] succeeded in 2.1579211620000933s: None 2024-02-23T00:16:01.262597888Z [2024-02-23 00:16:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[889325c1-b6d0-4b35-b39a-3b298a694396] received 2024-02-23T00:16:01.271747648Z [2024-02-23 00:16:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37197e65-51df-4fa3-86f4-ea353c971bd5] received 2024-02-23T00:16:01.276262927Z [2024-02-23 00:16:01,275: INFO/ForkPoolWorker-15] [889325c1-b6d0-4b35-b39a-3b298a694396] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:16:01.279221068Z [2024-02-23 00:16:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd91107c-cfa1-4bcf-9cf4-a582bf5e41fe] received 2024-02-23T00:16:01.282642603Z [2024-02-23 00:16:01,282: INFO/ForkPoolWorker-16] [37197e65-51df-4fa3-86f4-ea353c971bd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:16:01.293791617Z [2024-02-23 00:16:01,293: INFO/ForkPoolWorker-1] [bd91107c-cfa1-4bcf-9cf4-a582bf5e41fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:16:01.299622379Z [2024-02-23 00:16:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fb18b98-0593-4f71-a2a7-e02a0500c6f5] received 2024-02-23T00:16:01.314389121Z [2024-02-23 00:16:01,314: INFO/ForkPoolWorker-2] [8fb18b98-0593-4f71-a2a7-e02a0500c6f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:16:01.606002104Z [2024-02-23 00:16:01,602: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:16:01.614086210Z [2024-02-23 00:16:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:16:01.683779336Z [2024-02-23 00:16:01,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:16:01.778463444Z [2024-02-23 00:16:01,773: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:16:01.794349789Z [2024-02-23 00:16:01,793: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:16:01.800334355Z [2024-02-23 00:16:01,799: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:16:01.840806599Z [2024-02-23 00:16:01,840: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:16:01.847340291Z [2024-02-23 00:16:01,847: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:16:01.847408563Z [2024-02-23 00:16:01,847: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:16:01.847468172Z [2024-02-23 00:16:01,847: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:16:01.847798790Z [2024-02-23 00:16:01,847: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:16:01.985414507Z [2024-02-23 00:16:01,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:16:02.001008248Z [2024-02-23 00:16:02,000: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:16:02.740914151Z [2024-02-23 00:16:02,740: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[889325c1-b6d0-4b35-b39a-3b298a694396] succeeded in 1.4728290650000417s: None 2024-02-23T00:16:02.784304997Z [2024-02-23 00:16:02,783: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37197e65-51df-4fa3-86f4-ea353c971bd5] succeeded in 1.5095607759999439s: None 2024-02-23T00:16:02.960564357Z [2024-02-23 00:16:02,960: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:16:02.964838114Z [2024-02-23 00:16:02,964: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:16:02.989927529Z [2024-02-23 00:16:02,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:16:02.991375434Z [2024-02-23 00:16:02,991: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:16:02.991620680Z [2024-02-23 00:16:02,991: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:16:02.991907954Z [2024-02-23 00:16:02,991: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:16:02.991938889Z [2024-02-23 00:16:02,991: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:16:02.992409221Z [2024-02-23 00:16:02,992: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:16:02.992502524Z [2024-02-23 00:16:02,992: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:16:03.079857080Z [2024-02-23 00:16:03,079: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:16:03.173160565Z [2024-02-23 00:16:03,172: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:16:03.176660851Z [2024-02-23 00:16:03,176: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:16:03.200885094Z [2024-02-23 00:16:03,200: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:16:03.204181078Z [2024-02-23 00:16:03,203: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:16:03.204792872Z [2024-02-23 00:16:03,204: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:16:03.205009647Z [2024-02-23 00:16:03,204: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:16:03.205173654Z [2024-02-23 00:16:03,205: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:16:03.205535370Z [2024-02-23 00:16:03,205: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:16:03.206073251Z [2024-02-23 00:16:03,205: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:16:03.293447954Z [2024-02-23 00:16:03,293: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:16:04.555960478Z [2024-02-23 00:16:04,555: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bd91107c-cfa1-4bcf-9cf4-a582bf5e41fe] succeeded in 3.274385832000007s: None 2024-02-23T00:16:05.377057400Z [2024-02-23 00:16:05,376: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8fb18b98-0593-4f71-a2a7-e02a0500c6f5] succeeded in 4.075965621999785s: None 2024-02-23T00:17:00.864901135Z [2024-02-23 00:17:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cc85f19-2578-477d-a455-4232f07ec879] received 2024-02-23T00:17:00.876722934Z [2024-02-23 00:17:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db277109-73af-44f9-b7e6-03e2b0808c72] received 2024-02-23T00:17:00.880619338Z [2024-02-23 00:17:00,880: INFO/ForkPoolWorker-15] [8cc85f19-2578-477d-a455-4232f07ec879] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:17:00.883224798Z [2024-02-23 00:17:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ca454c-570d-4aeb-8d59-b1458a14750e] received 2024-02-23T00:17:00.889129689Z [2024-02-23 00:17:00,888: INFO/ForkPoolWorker-16] [db277109-73af-44f9-b7e6-03e2b0808c72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:17:00.895773935Z [2024-02-23 00:17:00,895: INFO/ForkPoolWorker-1] [c4ca454c-570d-4aeb-8d59-b1458a14750e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:17:01.282630385Z [2024-02-23 00:17:01,278: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:17:01.357186008Z [2024-02-23 00:17:01,352: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:17:01.386191833Z [2024-02-23 00:17:01,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:17:01.699242615Z [2024-02-23 00:17:01,698: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:17:01.704259178Z [2024-02-23 00:17:01,703: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:17:01.753733255Z [2024-02-23 00:17:01,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:17:01.756040575Z [2024-02-23 00:17:01,755: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:17:01.756327584Z [2024-02-23 00:17:01,756: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:17:01.756470065Z [2024-02-23 00:17:01,756: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:17:01.756916548Z [2024-02-23 00:17:01,756: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:17:01.897146325Z [2024-02-23 00:17:01,896: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:17:02.647871244Z [2024-02-23 00:17:02,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8cc85f19-2578-477d-a455-4232f07ec879] succeeded in 1.7797354389999782s: None 2024-02-23T00:17:02.798342028Z [2024-02-23 00:17:02,797: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:17:02.801891562Z [2024-02-23 00:17:02,801: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:17:02.828263702Z [2024-02-23 00:17:02,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:17:02.830087274Z [2024-02-23 00:17:02,829: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:17:02.830429139Z [2024-02-23 00:17:02,830: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:17:02.830893842Z [2024-02-23 00:17:02,830: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:17:02.832181216Z [2024-02-23 00:17:02,831: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:17:02.832868507Z [2024-02-23 00:17:02,832: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:17:02.833043863Z [2024-02-23 00:17:02,832: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:17:02.842383455Z [2024-02-23 00:17:02,841: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:17:02.846016069Z [2024-02-23 00:17:02,845: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:17:02.864617597Z [2024-02-23 00:17:02,864: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:17:02.865746882Z [2024-02-23 00:17:02,865: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:17:02.865769314Z [2024-02-23 00:17:02,865: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:17:02.865879729Z [2024-02-23 00:17:02,865: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:17:02.865917923Z [2024-02-23 00:17:02,865: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:17:02.866140766Z [2024-02-23 00:17:02,866: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:17:02.866152112Z [2024-02-23 00:17:02,866: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:17:02.961510301Z [2024-02-23 00:17:02,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:17:02.971473308Z [2024-02-23 00:17:02,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:17:04.651035268Z [2024-02-23 00:17:04,650: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4ca454c-570d-4aeb-8d59-b1458a14750e] succeeded in 3.765285378000044s: None 2024-02-23T00:17:05.106521262Z [2024-02-23 00:17:05,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db277109-73af-44f9-b7e6-03e2b0808c72] succeeded in 4.227190462000181s: None 2024-02-23T00:18:00.574983003Z [2024-02-23 00:18:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ba47630-c93e-487e-9801-fdb266336433] received 2024-02-23T00:18:00.585237599Z [2024-02-23 00:18:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[115b8015-c744-42fb-bfda-4499c22f6ec4] received 2024-02-23T00:18:00.592248278Z [2024-02-23 00:18:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1c27f91-dca2-48a8-aaf7-a2cc2cb92723] received 2024-02-23T00:18:00.593044115Z [2024-02-23 00:18:00,592: INFO/ForkPoolWorker-16] [115b8015-c744-42fb-bfda-4499c22f6ec4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:18:00.596027306Z [2024-02-23 00:18:00,594: INFO/ForkPoolWorker-15] [9ba47630-c93e-487e-9801-fdb266336433] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:18:00.612608646Z [2024-02-23 00:18:00,612: INFO/ForkPoolWorker-1] [f1c27f91-dca2-48a8-aaf7-a2cc2cb92723] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:18:00.616465999Z [2024-02-23 00:18:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0183d8fd-928a-4891-b08e-fd6dc15578b2] received 2024-02-23T00:18:00.703864848Z [2024-02-23 00:18:00,703: INFO/ForkPoolWorker-2] [0183d8fd-928a-4891-b08e-fd6dc15578b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:18:01.236367655Z [2024-02-23 00:18:01,228: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:18:01.407562311Z [2024-02-23 00:18:01,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:18:01.657414899Z [2024-02-23 00:18:01,656: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:18:01.670794594Z [2024-02-23 00:18:01,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:18:01.826887693Z [2024-02-23 00:18:01,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:18:01.836111528Z [2024-02-23 00:18:01,835: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:18:01.836530047Z [2024-02-23 00:18:01,836: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:18:01.836617522Z [2024-02-23 00:18:01,836: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:18:01.837407499Z [2024-02-23 00:18:01,837: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:18:02.278664172Z [2024-02-23 00:18:02,278: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:18:02.804385123Z [2024-02-23 00:18:02,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:18:02.823779067Z [2024-02-23 00:18:02,818: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:18:03.557514290Z [2024-02-23 00:18:03,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ba47630-c93e-487e-9801-fdb266336433] succeeded in 2.972182285999679s: None 2024-02-23T00:18:04.040384704Z [2024-02-23 00:18:04,040: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:18:05.095578384Z [2024-02-23 00:18:05,095: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[115b8015-c744-42fb-bfda-4499c22f6ec4] succeeded in 4.508557997000025s: None 2024-02-23T00:18:05.284469964Z [2024-02-23 00:18:05,284: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:18:05.288114541Z [2024-02-23 00:18:05,287: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:18:05.316334476Z [2024-02-23 00:18:05,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:18:05.318124769Z [2024-02-23 00:18:05,317: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:18:05.318335781Z [2024-02-23 00:18:05,318: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:18:05.318603730Z [2024-02-23 00:18:05,318: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:18:05.318748186Z [2024-02-23 00:18:05,318: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:18:05.319280024Z [2024-02-23 00:18:05,319: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:18:05.319453902Z [2024-02-23 00:18:05,319: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:18:05.440436246Z [2024-02-23 00:18:05,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:18:05.568128192Z [2024-02-23 00:18:05,567: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:18:05.571793151Z [2024-02-23 00:18:05,571: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:18:05.620665988Z [2024-02-23 00:18:05,620: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:18:05.622256496Z [2024-02-23 00:18:05,622: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:18:05.622271305Z [2024-02-23 00:18:05,622: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:18:05.622524039Z [2024-02-23 00:18:05,622: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:18:05.622564156Z [2024-02-23 00:18:05,622: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:18:05.622782594Z [2024-02-23 00:18:05,622: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:18:05.622913314Z [2024-02-23 00:18:05,622: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:18:05.757421336Z [2024-02-23 00:18:05,757: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:18:07.424088019Z [2024-02-23 00:18:07,423: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1c27f91-dca2-48a8-aaf7-a2cc2cb92723] succeeded in 6.823670445000062s: None 2024-02-23T00:18:08.885521104Z [2024-02-23 00:18:08,885: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0183d8fd-928a-4891-b08e-fd6dc15578b2] succeeded in 8.25674577000018s: None 2024-02-23T00:19:01.155946939Z [2024-02-23 00:19:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57e614f4-0b50-4c2e-ac78-c513bc3e8a48] received 2024-02-23T00:19:01.157916105Z [2024-02-23 00:19:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4ba9531-3e88-4426-ab4d-d048e35b0897] received 2024-02-23T00:19:01.168553407Z [2024-02-23 00:19:01,168: INFO/ForkPoolWorker-16] [f4ba9531-3e88-4426-ab4d-d048e35b0897] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:19:01.168838701Z [2024-02-23 00:19:01,168: INFO/ForkPoolWorker-15] [57e614f4-0b50-4c2e-ac78-c513bc3e8a48] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:19:01.172610339Z [2024-02-23 00:19:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a7aa518-1065-4e81-8ac4-5441bbfda7dc] received 2024-02-23T00:19:01.190629951Z [2024-02-23 00:19:01,189: INFO/ForkPoolWorker-1] [0a7aa518-1065-4e81-8ac4-5441bbfda7dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:19:01.584214387Z [2024-02-23 00:19:01,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:19:01.612935990Z [2024-02-23 00:19:01,608: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:19:01.634788979Z [2024-02-23 00:19:01,630: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:19:01.799578121Z [2024-02-23 00:19:01,799: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:19:01.803563265Z [2024-02-23 00:19:01,803: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:19:01.825542809Z [2024-02-23 00:19:01,825: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:19:01.829908453Z [2024-02-23 00:19:01,829: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:19:01.830057875Z [2024-02-23 00:19:01,829: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:19:01.830239066Z [2024-02-23 00:19:01,830: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:19:01.830547484Z [2024-02-23 00:19:01,830: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:19:01.949798761Z [2024-02-23 00:19:01,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:19:02.664169480Z [2024-02-23 00:19:02,663: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57e614f4-0b50-4c2e-ac78-c513bc3e8a48] succeeded in 1.5051408270001048s: None 2024-02-23T00:19:02.882396075Z [2024-02-23 00:19:02,882: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:19:02.886379421Z [2024-02-23 00:19:02,885: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:19:02.912053707Z [2024-02-23 00:19:02,911: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:19:02.914320936Z [2024-02-23 00:19:02,914: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:19:02.914442367Z [2024-02-23 00:19:02,914: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:19:02.914653717Z [2024-02-23 00:19:02,914: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:19:02.914765735Z [2024-02-23 00:19:02,914: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:19:02.915383940Z [2024-02-23 00:19:02,915: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:19:02.915556728Z [2024-02-23 00:19:02,915: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:19:03.014670942Z [2024-02-23 00:19:03,014: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:19:03.028119927Z [2024-02-23 00:19:03,027: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:19:03.031511896Z [2024-02-23 00:19:03,031: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:19:03.055200006Z [2024-02-23 00:19:03,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:19:03.056560448Z [2024-02-23 00:19:03,056: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:19:03.056717317Z [2024-02-23 00:19:03,056: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:19:03.056928231Z [2024-02-23 00:19:03,056: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:19:03.057097546Z [2024-02-23 00:19:03,056: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:19:03.057469398Z [2024-02-23 00:19:03,057: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:19:03.057682158Z [2024-02-23 00:19:03,057: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:19:03.166274696Z [2024-02-23 00:19:03,165: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:19:04.981133509Z [2024-02-23 00:19:04,980: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4ba9531-3e88-4426-ab4d-d048e35b0897] succeeded in 3.8206882069998755s: None 2024-02-23T00:19:05.432687667Z [2024-02-23 00:19:05,432: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a7aa518-1065-4e81-8ac4-5441bbfda7dc] succeeded in 4.254048164000324s: None 2024-02-23T00:20:01.172243943Z [2024-02-23 00:20:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cae6c24-2975-4e28-806d-22dd5838b671] received 2024-02-23T00:20:01.175439686Z [2024-02-23 00:20:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f46958be-0059-400f-8d20-f2c96885d404] received 2024-02-23T00:20:01.178675351Z [2024-02-23 00:20:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b37eed3-579d-4017-8a5d-c9e98dc216e7] received 2024-02-23T00:20:01.181089226Z [2024-02-23 00:20:01,180: INFO/ForkPoolWorker-15] [1cae6c24-2975-4e28-806d-22dd5838b671] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:20:01.181855801Z [2024-02-23 00:20:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67eec9f6-2e37-45b3-9ff2-edc3aef58cb0] received 2024-02-23T00:20:01.186039076Z [2024-02-23 00:20:01,185: INFO/ForkPoolWorker-1] [4b37eed3-579d-4017-8a5d-c9e98dc216e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:20:01.187610211Z [2024-02-23 00:20:01,187: INFO/ForkPoolWorker-16] [f46958be-0059-400f-8d20-f2c96885d404] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:20:01.195210073Z [2024-02-23 00:20:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3356a981-01d8-4825-bfc7-d9c2e3c1a74c] received 2024-02-23T00:20:01.202716607Z [2024-02-23 00:20:01,202: INFO/ForkPoolWorker-2] [67eec9f6-2e37-45b3-9ff2-edc3aef58cb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:20:01.208277388Z [2024-02-23 00:20:01,207: INFO/ForkPoolWorker-3] [3356a981-01d8-4825-bfc7-d9c2e3c1a74c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:20:01.511660424Z [2024-02-23 00:20:01,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:20:01.582264515Z [2024-02-23 00:20:01,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:20:01.812307903Z [2024-02-23 00:20:01,810: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:20:01.824943684Z [2024-02-23 00:20:01,824: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:01.834116321Z [2024-02-23 00:20:01,830: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:20:01.886873311Z [2024-02-23 00:20:01,886: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:20:01.890208627Z [2024-02-23 00:20:01,889: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:20:01.890504616Z [2024-02-23 00:20:01,890: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:20:01.890731801Z [2024-02-23 00:20:01,890: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:20:01.891074285Z [2024-02-23 00:20:01,890: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:20:01.917723243Z [2024-02-23 00:20:01,912: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:20:02.059994435Z [2024-02-23 00:20:02,059: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:02.104854598Z [2024-02-23 00:20:02,100: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:20:02.236367280Z [2024-02-23 00:20:02,236: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:02.761142293Z [2024-02-23 00:20:02,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b37eed3-579d-4017-8a5d-c9e98dc216e7] succeeded in 1.5808917300000758s: None 2024-02-23T00:20:02.947309471Z [2024-02-23 00:20:02,946: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f46958be-0059-400f-8d20-f2c96885d404] succeeded in 1.769864281000082s: None 2024-02-23T00:20:03.208156044Z [2024-02-23 00:20:03,207: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:20:03.212050644Z [2024-02-23 00:20:03,211: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:03.245594199Z [2024-02-23 00:20:03,245: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:20:03.247049805Z [2024-02-23 00:20:03,246: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:20:03.247179229Z [2024-02-23 00:20:03,246: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:20:03.247358778Z [2024-02-23 00:20:03,247: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:20:03.247520509Z [2024-02-23 00:20:03,247: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:20:03.247824563Z [2024-02-23 00:20:03,247: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:20:03.247872671Z [2024-02-23 00:20:03,247: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:20:03.346231372Z [2024-02-23 00:20:03,345: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:03.738913888Z [2024-02-23 00:20:03,738: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:20:03.752192737Z [2024-02-23 00:20:03,751: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:03.793980202Z [2024-02-23 00:20:03,793: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:20:03.795688526Z [2024-02-23 00:20:03,795: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:20:03.795874325Z [2024-02-23 00:20:03,795: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:20:03.796164211Z [2024-02-23 00:20:03,795: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:20:03.796351318Z [2024-02-23 00:20:03,796: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:20:03.796734336Z [2024-02-23 00:20:03,796: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:20:03.796840718Z [2024-02-23 00:20:03,796: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:20:03.921771055Z [2024-02-23 00:20:03,921: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:20:03.926058773Z [2024-02-23 00:20:03,925: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:03.936182175Z [2024-02-23 00:20:03,935: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:03.969458648Z [2024-02-23 00:20:03,969: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:20:03.977261284Z [2024-02-23 00:20:03,976: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:20:03.977321910Z [2024-02-23 00:20:03,977: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:20:03.982767796Z [2024-02-23 00:20:03,982: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:20:03.982890877Z [2024-02-23 00:20:03,982: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:20:03.983198639Z [2024-02-23 00:20:03,983: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:20:03.983294202Z [2024-02-23 00:20:03,983: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:20:04.100953098Z [2024-02-23 00:20:04,100: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:04.125750819Z [2024-02-23 00:20:04,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cae6c24-2975-4e28-806d-22dd5838b671] succeeded in 2.9488509689999773s: None 2024-02-23T00:20:04.945899794Z [2024-02-23 00:20:04,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62e0cfc0-f08e-4cea-9bb2-7c9deb53f74f] received 2024-02-23T00:20:04.954555675Z [2024-02-23 00:20:04,954: INFO/ForkPoolWorker-15] [62e0cfc0-f08e-4cea-9bb2-7c9deb53f74f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:20:05.301308591Z [2024-02-23 00:20:05,298: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:20:05.801951599Z [2024-02-23 00:20:05,801: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3356a981-01d8-4825-bfc7-d9c2e3c1a74c] succeeded in 4.604120516999956s: None 2024-02-23T00:20:06.465503600Z [2024-02-23 00:20:06,465: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[67eec9f6-2e37-45b3-9ff2-edc3aef58cb0] succeeded in 5.2807365049998225s: None 2024-02-23T00:20:06.534362997Z [2024-02-23 00:20:06,533: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:20:06.538556836Z [2024-02-23 00:20:06,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:06.561991081Z [2024-02-23 00:20:06,561: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:20:06.564648698Z [2024-02-23 00:20:06,564: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:20:06.564881888Z [2024-02-23 00:20:06,564: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:20:06.565170343Z [2024-02-23 00:20:06,564: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:20:06.565389635Z [2024-02-23 00:20:06,565: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:20:06.565988702Z [2024-02-23 00:20:06,565: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:20:06.566616868Z [2024-02-23 00:20:06,566: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:20:06.714500125Z [2024-02-23 00:20:06,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:07.446755068Z [2024-02-23 00:20:07,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62e0cfc0-f08e-4cea-9bb2-7c9deb53f74f] succeeded in 2.4988776180002787s: None 2024-02-23T00:20:08.452877679Z [2024-02-23 00:20:08,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94acbe3f-6fdb-40a5-a770-3b1cb607e2ce] received 2024-02-23T00:20:08.462461036Z [2024-02-23 00:20:08,462: INFO/ForkPoolWorker-15] [94acbe3f-6fdb-40a5-a770-3b1cb607e2ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:20:08.767889934Z [2024-02-23 00:20:08,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:20:10.020838257Z [2024-02-23 00:20:10,020: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:20:10.026475113Z [2024-02-23 00:20:10,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:10.050634687Z [2024-02-23 00:20:10,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:20:10.052746324Z [2024-02-23 00:20:10,052: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:20:10.052827799Z [2024-02-23 00:20:10,052: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:20:10.053013760Z [2024-02-23 00:20:10,052: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:20:10.055403228Z [2024-02-23 00:20:10,054: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:20:10.056161128Z [2024-02-23 00:20:10,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:20:10.057277240Z [2024-02-23 00:20:10,056: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:20:10.195014002Z [2024-02-23 00:20:10,192: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:10.840235461Z [2024-02-23 00:20:10,839: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94acbe3f-6fdb-40a5-a770-3b1cb607e2ce] succeeded in 2.3850345169998945s: None 2024-02-23T00:20:11.259678010Z [2024-02-23 00:20:11,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89fd6773-b601-46fb-b53d-f7f88c19d2fb] received 2024-02-23T00:20:11.269111535Z [2024-02-23 00:20:11,268: INFO/ForkPoolWorker-15] [89fd6773-b601-46fb-b53d-f7f88c19d2fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:20:11.633163408Z [2024-02-23 00:20:11,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:20:12.786621566Z [2024-02-23 00:20:12,786: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:20:12.790098109Z [2024-02-23 00:20:12,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:20:12.807682253Z [2024-02-23 00:20:12,807: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:20:12.809244219Z [2024-02-23 00:20:12,808: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:20:12.809336806Z [2024-02-23 00:20:12,809: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:20:12.809589374Z [2024-02-23 00:20:12,809: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:20:12.809697666Z [2024-02-23 00:20:12,809: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:20:12.810057202Z [2024-02-23 00:20:12,809: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:20:12.810142639Z [2024-02-23 00:20:12,810: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:20:12.890249569Z [2024-02-23 00:20:12,889: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:20:13.491125311Z [2024-02-23 00:20:13,490: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89fd6773-b601-46fb-b53d-f7f88c19d2fb] succeeded in 2.229180422999889s: None 2024-02-23T00:21:01.040603111Z [2024-02-23 00:21:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[121e3aef-4b65-4aab-8e90-61120a1187f6] received 2024-02-23T00:21:01.045257348Z [2024-02-23 00:21:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9418bf48-b77c-417f-b7e0-247471e40320] received 2024-02-23T00:21:01.047874396Z [2024-02-23 00:21:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d6d4228-a2bf-4461-a3f6-5ceedb13e0ef] received 2024-02-23T00:21:01.082563052Z [2024-02-23 00:21:01,062: INFO/ForkPoolWorker-1] [8d6d4228-a2bf-4461-a3f6-5ceedb13e0ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:21:01.082593380Z [2024-02-23 00:21:01,068: INFO/ForkPoolWorker-15] [121e3aef-4b65-4aab-8e90-61120a1187f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:21:01.082618039Z [2024-02-23 00:21:01,069: INFO/ForkPoolWorker-16] [9418bf48-b77c-417f-b7e0-247471e40320] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:21:01.435010469Z [2024-02-23 00:21:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:21:01.450007388Z [2024-02-23 00:21:01,445: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:21:01.486737025Z [2024-02-23 00:21:01,481: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:21:01.668192074Z [2024-02-23 00:21:01,667: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:21:01.672985779Z [2024-02-23 00:21:01,672: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:21:01.699698539Z [2024-02-23 00:21:01,699: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:21:01.700819446Z [2024-02-23 00:21:01,700: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:21:01.700897861Z [2024-02-23 00:21:01,700: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:21:01.700955045Z [2024-02-23 00:21:01,700: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:21:01.701140952Z [2024-02-23 00:21:01,701: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:21:01.805239801Z [2024-02-23 00:21:01,804: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:21:02.566643290Z [2024-02-23 00:21:02,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8d6d4228-a2bf-4461-a3f6-5ceedb13e0ef] succeeded in 1.5168511169999874s: None 2024-02-23T00:21:02.668739475Z [2024-02-23 00:21:02,668: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:21:02.672692311Z [2024-02-23 00:21:02,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:21:02.700756948Z [2024-02-23 00:21:02,700: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:21:02.702913905Z [2024-02-23 00:21:02,702: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:21:02.702933919Z [2024-02-23 00:21:02,702: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:21:02.703295512Z [2024-02-23 00:21:02,702: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:21:02.703454460Z [2024-02-23 00:21:02,703: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:21:02.704004092Z [2024-02-23 00:21:02,703: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:21:02.704116508Z [2024-02-23 00:21:02,703: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:21:02.751272065Z [2024-02-23 00:21:02,750: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:21:02.755018772Z [2024-02-23 00:21:02,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:21:02.788153638Z [2024-02-23 00:21:02,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:21:02.793765773Z [2024-02-23 00:21:02,793: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:21:02.793801712Z [2024-02-23 00:21:02,793: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:21:02.794028690Z [2024-02-23 00:21:02,793: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:21:02.794048735Z [2024-02-23 00:21:02,793: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:21:02.794424026Z [2024-02-23 00:21:02,794: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:21:02.794442329Z [2024-02-23 00:21:02,794: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:21:02.840363209Z [2024-02-23 00:21:02,839: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:21:02.898496585Z [2024-02-23 00:21:02,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:21:06.012418964Z [2024-02-23 00:21:06,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[121e3aef-4b65-4aab-8e90-61120a1187f6] succeeded in 4.96308943799977s: None 2024-02-23T00:21:07.210611477Z [2024-02-23 00:21:07,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9418bf48-b77c-417f-b7e0-247471e40320] succeeded in 6.161928454999725s: None 2024-02-23T00:22:00.663702847Z [2024-02-23 00:22:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[909072b5-fb36-4781-af94-56b0c56b8b0c] received 2024-02-23T00:22:00.670054978Z [2024-02-23 00:22:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[583fdcd2-3a20-48d4-bef8-3413b58c4cd0] received 2024-02-23T00:22:00.671998758Z [2024-02-23 00:22:00,671: INFO/ForkPoolWorker-15] [909072b5-fb36-4781-af94-56b0c56b8b0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:22:00.677156566Z [2024-02-23 00:22:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8f8c8f8-3aa8-4d26-9deb-7df35198a0cb] received 2024-02-23T00:22:00.678954607Z [2024-02-23 00:22:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83bb276c-dafc-49f0-87e4-515313a90aa6] received 2024-02-23T00:22:00.681273249Z [2024-02-23 00:22:00,681: INFO/ForkPoolWorker-16] [583fdcd2-3a20-48d4-bef8-3413b58c4cd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:22:00.699630446Z [2024-02-23 00:22:00,699: INFO/ForkPoolWorker-2] [83bb276c-dafc-49f0-87e4-515313a90aa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:22:00.706135435Z [2024-02-23 00:22:00,705: INFO/ForkPoolWorker-1] [b8f8c8f8-3aa8-4d26-9deb-7df35198a0cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:22:01.178852091Z [2024-02-23 00:22:01,174: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:22:01.218423778Z [2024-02-23 00:22:01,210: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:22:01.334071566Z [2024-02-23 00:22:01,325: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:22:01.343043085Z [2024-02-23 00:22:01,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:22:01.590971475Z [2024-02-23 00:22:01,590: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:22:01.770580029Z [2024-02-23 00:22:01,770: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:22:01.794975196Z [2024-02-23 00:22:01,790: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:22:01.864104089Z [2024-02-23 00:22:01,863: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:22:01.869414975Z [2024-02-23 00:22:01,868: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:22:01.869645504Z [2024-02-23 00:22:01,869: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:22:01.869671590Z [2024-02-23 00:22:01,869: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:22:01.869944879Z [2024-02-23 00:22:01,869: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:22:02.150796017Z [2024-02-23 00:22:02,150: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:22:02.504522238Z [2024-02-23 00:22:02,504: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[583fdcd2-3a20-48d4-bef8-3413b58c4cd0] succeeded in 1.8307762760000514s: None 2024-02-23T00:22:02.908009899Z [2024-02-23 00:22:02,907: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[83bb276c-dafc-49f0-87e4-515313a90aa6] succeeded in 2.2228089840000393s: None 2024-02-23T00:22:03.175508208Z [2024-02-23 00:22:03,175: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:22:03.179362264Z [2024-02-23 00:22:03,178: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:22:03.206698060Z [2024-02-23 00:22:03,206: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:22:03.210671999Z [2024-02-23 00:22:03,210: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:22:03.210820530Z [2024-02-23 00:22:03,210: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:22:03.211149464Z [2024-02-23 00:22:03,210: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:22:03.211273516Z [2024-02-23 00:22:03,211: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:22:03.213078022Z [2024-02-23 00:22:03,212: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:22:03.213389298Z [2024-02-23 00:22:03,213: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:22:03.318725870Z [2024-02-23 00:22:03,317: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:22:03.443589820Z [2024-02-23 00:22:03,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:22:03.447576120Z [2024-02-23 00:22:03,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:22:03.472546202Z [2024-02-23 00:22:03,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:22:03.474161759Z [2024-02-23 00:22:03,473: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:22:03.474237715Z [2024-02-23 00:22:03,474: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:22:03.474479018Z [2024-02-23 00:22:03,474: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:22:03.474485686Z [2024-02-23 00:22:03,474: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:22:03.474771125Z [2024-02-23 00:22:03,474: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:22:03.474881032Z [2024-02-23 00:22:03,474: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:22:03.573966171Z [2024-02-23 00:22:03,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:22:06.522577611Z [2024-02-23 00:22:06,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8f8c8f8-3aa8-4d26-9deb-7df35198a0cb] succeeded in 5.842992525999762s: None 2024-02-23T00:22:06.880264164Z [2024-02-23 00:22:06,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[909072b5-fb36-4781-af94-56b0c56b8b0c] succeeded in 6.215239795999878s: None 2024-02-23T00:23:00.552753436Z [2024-02-23 00:23:00,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a857c51-8571-47d5-b5a6-4585fa95e68f] received 2024-02-23T00:23:00.560443748Z [2024-02-23 00:23:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5931bad7-d0b1-4014-9452-46027db8ff74] received 2024-02-23T00:23:00.563965842Z [2024-02-23 00:23:00,563: INFO/ForkPoolWorker-15] [0a857c51-8571-47d5-b5a6-4585fa95e68f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:23:00.564079920Z [2024-02-23 00:23:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03d03b66-ca3e-4f2f-8289-4d89ecb3f274] received 2024-02-23T00:23:00.574905362Z [2024-02-23 00:23:00,574: INFO/ForkPoolWorker-1] [03d03b66-ca3e-4f2f-8289-4d89ecb3f274] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:23:00.575538730Z [2024-02-23 00:23:00,574: INFO/ForkPoolWorker-16] [5931bad7-d0b1-4014-9452-46027db8ff74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:23:00.863435355Z [2024-02-23 00:23:00,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:23:00.979781936Z [2024-02-23 00:23:00,974: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:23:01.106242158Z [2024-02-23 00:23:01,102: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:23:01.303447003Z [2024-02-23 00:23:01,303: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:23:01.308292412Z [2024-02-23 00:23:01,307: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:23:01.343916311Z [2024-02-23 00:23:01,343: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:23:01.347515240Z [2024-02-23 00:23:01,347: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:23:01.347663325Z [2024-02-23 00:23:01,347: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:23:01.347800133Z [2024-02-23 00:23:01,347: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:23:01.348082446Z [2024-02-23 00:23:01,347: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:23:01.439300122Z [2024-02-23 00:23:01,439: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:23:02.163304776Z [2024-02-23 00:23:02,162: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03d03b66-ca3e-4f2f-8289-4d89ecb3f274] succeeded in 1.5937913180000578s: None 2024-02-23T00:23:02.248991880Z [2024-02-23 00:23:02,248: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:23:02.253392037Z [2024-02-23 00:23:02,252: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:23:02.276614989Z [2024-02-23 00:23:02,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:23:02.277923837Z [2024-02-23 00:23:02,277: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:23:02.277945311Z [2024-02-23 00:23:02,277: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:23:02.278067813Z [2024-02-23 00:23:02,277: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:23:02.278105215Z [2024-02-23 00:23:02,278: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:23:02.278398332Z [2024-02-23 00:23:02,278: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:23:02.278446104Z [2024-02-23 00:23:02,278: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:23:02.377618960Z [2024-02-23 00:23:02,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:23:02.526990377Z [2024-02-23 00:23:02,526: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:23:02.531063089Z [2024-02-23 00:23:02,530: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:23:02.556633057Z [2024-02-23 00:23:02,556: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:23:02.559434055Z [2024-02-23 00:23:02,558: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:23:02.559535289Z [2024-02-23 00:23:02,559: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:23:02.559653658Z [2024-02-23 00:23:02,559: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:23:02.559691775Z [2024-02-23 00:23:02,559: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:23:02.560590695Z [2024-02-23 00:23:02,560: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:23:02.560626204Z [2024-02-23 00:23:02,560: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:23:02.656600332Z [2024-02-23 00:23:02,656: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:23:04.925609870Z [2024-02-23 00:23:04,924: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a857c51-8571-47d5-b5a6-4585fa95e68f] succeeded in 4.370518456999889s: None 2024-02-23T00:23:05.491841531Z [2024-02-23 00:23:05,491: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5931bad7-d0b1-4014-9452-46027db8ff74] succeeded in 4.92997517699996s: None 2024-02-23T00:24:00.418470883Z [2024-02-23 00:24:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e7db0b0-780c-4c18-bf7a-1d5566608cea] received 2024-02-23T00:24:00.421602968Z [2024-02-23 00:24:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27ce08fb-944d-4703-a9fc-cc24d5958b45] received 2024-02-23T00:24:00.423752533Z [2024-02-23 00:24:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15f2e21a-7154-4023-9ae6-3b090e6cc66a] received 2024-02-23T00:24:00.425278735Z [2024-02-23 00:24:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac1568cf-e453-4b7c-8be2-95e3655de3cd] received 2024-02-23T00:24:00.435924303Z [2024-02-23 00:24:00,435: INFO/ForkPoolWorker-2] [ac1568cf-e453-4b7c-8be2-95e3655de3cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:24:00.441773086Z [2024-02-23 00:24:00,441: INFO/ForkPoolWorker-1] [15f2e21a-7154-4023-9ae6-3b090e6cc66a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:24:00.445991607Z [2024-02-23 00:24:00,445: INFO/ForkPoolWorker-15] [2e7db0b0-780c-4c18-bf7a-1d5566608cea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:24:00.448226603Z [2024-02-23 00:24:00,447: INFO/ForkPoolWorker-16] [27ce08fb-944d-4703-a9fc-cc24d5958b45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:24:00.735689442Z [2024-02-23 00:24:00,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:24:00.816318342Z [2024-02-23 00:24:00,813: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:24:00.975525982Z [2024-02-23 00:24:00,972: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:24:01.048232682Z [2024-02-23 00:24:01,045: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:24:01.070117146Z [2024-02-23 00:24:01,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:24:01.240285772Z [2024-02-23 00:24:01,239: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:24:01.245459329Z [2024-02-23 00:24:01,244: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:24:01.305054133Z [2024-02-23 00:24:01,304: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:24:01.315505932Z [2024-02-23 00:24:01,315: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:24:01.315592233Z [2024-02-23 00:24:01,315: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:24:01.315614316Z [2024-02-23 00:24:01,315: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:24:01.315796458Z [2024-02-23 00:24:01,315: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:24:01.479743239Z [2024-02-23 00:24:01,479: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:24:01.853120427Z [2024-02-23 00:24:01,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e7db0b0-780c-4c18-bf7a-1d5566608cea] succeeded in 1.4313969760000873s: None 2024-02-23T00:24:02.160658278Z [2024-02-23 00:24:02,160: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac1568cf-e453-4b7c-8be2-95e3655de3cd] succeeded in 1.7325380980000773s: None 2024-02-23T00:24:02.468673583Z [2024-02-23 00:24:02,468: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:24:02.471814821Z [2024-02-23 00:24:02,471: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:24:02.506871705Z [2024-02-23 00:24:02,506: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:24:02.510353613Z [2024-02-23 00:24:02,509: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:24:02.510426652Z [2024-02-23 00:24:02,510: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:24:02.510681597Z [2024-02-23 00:24:02,510: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:24:02.510911815Z [2024-02-23 00:24:02,510: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:24:02.511914398Z [2024-02-23 00:24:02,511: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:24:02.512007292Z [2024-02-23 00:24:02,511: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:24:02.550715333Z [2024-02-23 00:24:02,550: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:24:02.554430649Z [2024-02-23 00:24:02,553: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:24:02.585592168Z [2024-02-23 00:24:02,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:24:02.588345743Z [2024-02-23 00:24:02,587: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:24:02.588834574Z [2024-02-23 00:24:02,588: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:24:02.589300020Z [2024-02-23 00:24:02,588: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:24:02.589916888Z [2024-02-23 00:24:02,589: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:24:02.590463787Z [2024-02-23 00:24:02,590: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:24:02.590652159Z [2024-02-23 00:24:02,590: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:24:02.610508251Z [2024-02-23 00:24:02,610: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:24:02.696172223Z [2024-02-23 00:24:02,695: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:24:04.408468706Z [2024-02-23 00:24:04,407: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27ce08fb-944d-4703-a9fc-cc24d5958b45] succeeded in 3.9841634899999008s: None 2024-02-23T00:24:04.430349738Z [2024-02-23 00:24:04,429: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15f2e21a-7154-4023-9ae6-3b090e6cc66a] succeeded in 4.003982136000104s: None 2024-02-23T00:25:00.377350101Z [2024-02-23 00:25:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26234b9a-e85a-40a3-83a7-18cb59788e62] received 2024-02-23T00:25:00.380912136Z [2024-02-23 00:25:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99b50dc3-3fc0-4567-9095-e06e97bf07ca] received 2024-02-23T00:25:00.389081460Z [2024-02-23 00:25:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff07b69d-8d66-4b0a-ac5f-6d0529dcf051] received 2024-02-23T00:25:00.391247636Z [2024-02-23 00:25:00,390: INFO/ForkPoolWorker-15] [26234b9a-e85a-40a3-83a7-18cb59788e62] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:25:00.395953354Z [2024-02-23 00:25:00,395: INFO/ForkPoolWorker-16] [99b50dc3-3fc0-4567-9095-e06e97bf07ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:25:00.397939037Z [2024-02-23 00:25:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7baee1ca-ffaf-4521-af04-7ad16154531c] received 2024-02-23T00:25:00.398729797Z [2024-02-23 00:25:00,398: INFO/ForkPoolWorker-1] [ff07b69d-8d66-4b0a-ac5f-6d0529dcf051] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:25:00.414331065Z [2024-02-23 00:25:00,414: INFO/ForkPoolWorker-2] [7baee1ca-ffaf-4521-af04-7ad16154531c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:25:00.693909744Z [2024-02-23 00:25:00,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:25:00.725959280Z [2024-02-23 00:25:00,722: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:25:00.781363205Z [2024-02-23 00:25:00,778: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:25:00.790042203Z [2024-02-23 00:25:00,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:25:00.856717914Z [2024-02-23 00:25:00,856: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:25:00.860625924Z [2024-02-23 00:25:00,860: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:00.897189709Z [2024-02-23 00:25:00,896: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:25:00.900488049Z [2024-02-23 00:25:00,900: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:25:00.900528856Z [2024-02-23 00:25:00,900: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:25:00.900705791Z [2024-02-23 00:25:00,900: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:25:00.900994365Z [2024-02-23 00:25:00,900: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:25:01.050307203Z [2024-02-23 00:25:01,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:01.735024986Z [2024-02-23 00:25:01,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26234b9a-e85a-40a3-83a7-18cb59788e62] succeeded in 1.3524760319996858s: None 2024-02-23T00:25:02.072494655Z [2024-02-23 00:25:02,072: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:25:02.076352982Z [2024-02-23 00:25:02,075: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:02.085769832Z [2024-02-23 00:25:02,085: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:25:02.090318127Z [2024-02-23 00:25:02,089: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:02.117836302Z [2024-02-23 00:25:02,117: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:25:02.119903471Z [2024-02-23 00:25:02,119: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:25:02.119967792Z [2024-02-23 00:25:02,119: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:25:02.120081209Z [2024-02-23 00:25:02,119: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:25:02.120262855Z [2024-02-23 00:25:02,120: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:25:02.120574179Z [2024-02-23 00:25:02,120: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:25:02.120691518Z [2024-02-23 00:25:02,120: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:25:02.135789988Z [2024-02-23 00:25:02,135: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:25:02.142458810Z [2024-02-23 00:25:02,142: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:25:02.142485332Z [2024-02-23 00:25:02,142: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:25:02.142721738Z [2024-02-23 00:25:02,142: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:25:02.142866734Z [2024-02-23 00:25:02,142: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:25:02.143263836Z [2024-02-23 00:25:02,143: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:25:02.143995682Z [2024-02-23 00:25:02,143: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:25:02.222039651Z [2024-02-23 00:25:02,221: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:25:02.225705451Z [2024-02-23 00:25:02,225: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:02.280634497Z [2024-02-23 00:25:02,280: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:25:02.283423534Z [2024-02-23 00:25:02,283: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:25:02.283556042Z [2024-02-23 00:25:02,283: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:25:02.283833297Z [2024-02-23 00:25:02,283: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:25:02.283984601Z [2024-02-23 00:25:02,283: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:25:02.284339406Z [2024-02-23 00:25:02,284: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:25:02.284490507Z [2024-02-23 00:25:02,284: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:25:02.290660824Z [2024-02-23 00:25:02,289: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:02.317877059Z [2024-02-23 00:25:02,317: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:02.503912316Z [2024-02-23 00:25:02,502: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:03.063093067Z [2024-02-23 00:25:03,062: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff07b69d-8d66-4b0a-ac5f-6d0529dcf051] succeeded in 2.6727277569998478s: None 2024-02-23T00:25:03.416798144Z [2024-02-23 00:25:03,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74093174-5dc3-4985-a087-1173a63c0186] received 2024-02-23T00:25:03.425370767Z [2024-02-23 00:25:03,424: INFO/ForkPoolWorker-15] [74093174-5dc3-4985-a087-1173a63c0186] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:25:03.759674871Z [2024-02-23 00:25:03,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:25:04.021148429Z [2024-02-23 00:25:04,020: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99b50dc3-3fc0-4567-9095-e06e97bf07ca] succeeded in 3.637970919000054s: None 2024-02-23T00:25:04.486930650Z [2024-02-23 00:25:04,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7baee1ca-ffaf-4521-af04-7ad16154531c] succeeded in 4.082533388000229s: None 2024-02-23T00:25:04.904461612Z [2024-02-23 00:25:04,903: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:25:04.907822555Z [2024-02-23 00:25:04,907: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:04.936565004Z [2024-02-23 00:25:04,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:25:04.938177839Z [2024-02-23 00:25:04,937: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:25:04.938224205Z [2024-02-23 00:25:04,938: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:25:04.938420357Z [2024-02-23 00:25:04,938: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:25:04.938440076Z [2024-02-23 00:25:04,938: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:25:04.938923594Z [2024-02-23 00:25:04,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:25:04.939018664Z [2024-02-23 00:25:04,938: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:25:05.034344128Z [2024-02-23 00:25:05,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:05.794483566Z [2024-02-23 00:25:05,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74093174-5dc3-4985-a087-1173a63c0186] succeeded in 2.3750162860001183s: None 2024-02-23T00:25:05.909585538Z [2024-02-23 00:25:05,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c75563e0-8ff7-4f65-bb39-35c12087106e] received 2024-02-23T00:25:05.918883344Z [2024-02-23 00:25:05,918: INFO/ForkPoolWorker-15] [c75563e0-8ff7-4f65-bb39-35c12087106e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:25:06.218972696Z [2024-02-23 00:25:06,215: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:25:07.398094051Z [2024-02-23 00:25:07,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:25:07.401747501Z [2024-02-23 00:25:07,401: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:07.419947996Z [2024-02-23 00:25:07,419: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:25:07.421663988Z [2024-02-23 00:25:07,421: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:25:07.421948015Z [2024-02-23 00:25:07,421: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:25:07.422109334Z [2024-02-23 00:25:07,421: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:25:07.422267280Z [2024-02-23 00:25:07,422: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:25:07.422666913Z [2024-02-23 00:25:07,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:25:07.422909875Z [2024-02-23 00:25:07,422: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:25:07.534260239Z [2024-02-23 00:25:07,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:08.294106627Z [2024-02-23 00:25:08,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f51c1f85-db56-488b-a27c-d56b5bee6751] received 2024-02-23T00:25:08.319537271Z [2024-02-23 00:25:08,319: INFO/ForkPoolWorker-16] [f51c1f85-db56-488b-a27c-d56b5bee6751] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:25:08.325984648Z [2024-02-23 00:25:08,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c75563e0-8ff7-4f65-bb39-35c12087106e] succeeded in 2.4148238259999744s: None 2024-02-23T00:25:08.677724541Z [2024-02-23 00:25:08,674: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:25:10.205642321Z [2024-02-23 00:25:10,205: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:25:10.213290689Z [2024-02-23 00:25:10,212: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:25:10.246817327Z [2024-02-23 00:25:10,246: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:25:10.248483504Z [2024-02-23 00:25:10,248: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:25:10.248533684Z [2024-02-23 00:25:10,248: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:25:10.248769333Z [2024-02-23 00:25:10,248: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:25:10.248785646Z [2024-02-23 00:25:10,248: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:25:10.249560009Z [2024-02-23 00:25:10,249: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:25:10.249787382Z [2024-02-23 00:25:10,249: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:25:10.349963283Z [2024-02-23 00:25:10,349: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:25:10.835384000Z [2024-02-23 00:25:10,834: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f51c1f85-db56-488b-a27c-d56b5bee6751] succeeded in 2.535068658s: None 2024-02-23T00:26:01.208112052Z [2024-02-23 00:26:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68aa1bce-4c64-4802-a675-46c738f699a9] received 2024-02-23T00:26:01.209774385Z [2024-02-23 00:26:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d782f799-4710-42bf-818e-029b339ec744] received 2024-02-23T00:26:01.212170192Z [2024-02-23 00:26:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c66a0503-3e65-4802-a14b-853cb4990f1d] received 2024-02-23T00:26:01.215090061Z [2024-02-23 00:26:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6993ab5-fe99-4b8c-910d-71e26883347a] received 2024-02-23T00:26:01.221641569Z [2024-02-23 00:26:01,221: INFO/ForkPoolWorker-1] [c66a0503-3e65-4802-a14b-853cb4990f1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:26:01.222182834Z [2024-02-23 00:26:01,221: INFO/ForkPoolWorker-16] [d782f799-4710-42bf-818e-029b339ec744] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:26:01.227014036Z [2024-02-23 00:26:01,226: INFO/ForkPoolWorker-15] [68aa1bce-4c64-4802-a675-46c738f699a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:26:01.231528169Z [2024-02-23 00:26:01,231: INFO/ForkPoolWorker-2] [d6993ab5-fe99-4b8c-910d-71e26883347a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:26:01.538954810Z [2024-02-23 00:26:01,535: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:26:01.706783631Z [2024-02-23 00:26:01,703: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:26:01.741859127Z [2024-02-23 00:26:01,738: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:26:01.857978244Z [2024-02-23 00:26:01,852: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:26:01.929640203Z [2024-02-23 00:26:01,929: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:26:01.934037847Z [2024-02-23 00:26:01,933: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:26:01.985958257Z [2024-02-23 00:26:01,985: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:26:01.989842043Z [2024-02-23 00:26:01,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:26:01.991421709Z [2024-02-23 00:26:01,991: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:26:01.991637277Z [2024-02-23 00:26:01,991: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:26:01.991759437Z [2024-02-23 00:26:01,991: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:26:01.992050200Z [2024-02-23 00:26:01,991: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:26:02.126545197Z [2024-02-23 00:26:02,126: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:26:02.651861373Z [2024-02-23 00:26:02,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68aa1bce-4c64-4802-a675-46c738f699a9] succeeded in 1.4402436499999567s: None 2024-02-23T00:26:02.842909158Z [2024-02-23 00:26:02,842: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d782f799-4710-42bf-818e-029b339ec744] succeeded in 1.631628524000007s: None 2024-02-23T00:26:02.993041611Z [2024-02-23 00:26:02,992: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:26:02.996854164Z [2024-02-23 00:26:02,996: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:26:03.021795353Z [2024-02-23 00:26:03,021: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:26:03.023081232Z [2024-02-23 00:26:03,022: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:26:03.023106717Z [2024-02-23 00:26:03,023: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:26:03.023232024Z [2024-02-23 00:26:03,023: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:26:03.023246408Z [2024-02-23 00:26:03,023: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:26:03.023493047Z [2024-02-23 00:26:03,023: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:26:03.023524447Z [2024-02-23 00:26:03,023: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:26:03.111480778Z [2024-02-23 00:26:03,111: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:26:03.522024526Z [2024-02-23 00:26:03,521: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:26:03.525523326Z [2024-02-23 00:26:03,525: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:26:03.543244971Z [2024-02-23 00:26:03,543: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:26:03.544772879Z [2024-02-23 00:26:03,544: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:26:03.544924836Z [2024-02-23 00:26:03,544: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:26:03.545117934Z [2024-02-23 00:26:03,544: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:26:03.545249942Z [2024-02-23 00:26:03,545: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:26:03.545581741Z [2024-02-23 00:26:03,545: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:26:03.545724660Z [2024-02-23 00:26:03,545: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:26:03.629860963Z [2024-02-23 00:26:03,629: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:26:05.132978771Z [2024-02-23 00:26:05,132: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d6993ab5-fe99-4b8c-910d-71e26883347a] succeeded in 3.9138320870001735s: None 2024-02-23T00:26:05.522595352Z [2024-02-23 00:26:05,522: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c66a0503-3e65-4802-a14b-853cb4990f1d] succeeded in 4.308186914000089s: None 2024-02-23T00:27:00.383570511Z [2024-02-23 00:27:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fb170bc-5db7-470a-9f7d-ea973ed722e0] received 2024-02-23T00:27:00.389375830Z [2024-02-23 00:27:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d8b27b9-09f2-47e9-9141-2a02ee8a376d] received 2024-02-23T00:27:00.391656811Z [2024-02-23 00:27:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e103d668-0558-4926-93fa-c6d8e223df28] received 2024-02-23T00:27:00.398589957Z [2024-02-23 00:27:00,398: INFO/ForkPoolWorker-15] [6fb170bc-5db7-470a-9f7d-ea973ed722e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:27:00.401471195Z [2024-02-23 00:27:00,401: INFO/ForkPoolWorker-16] [3d8b27b9-09f2-47e9-9141-2a02ee8a376d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:27:00.412852010Z [2024-02-23 00:27:00,412: INFO/ForkPoolWorker-1] [e103d668-0558-4926-93fa-c6d8e223df28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:27:00.696645860Z [2024-02-23 00:27:00,693: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:27:00.711786550Z [2024-02-23 00:27:00,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:27:00.711885313Z [2024-02-23 00:27:00,708: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:27:00.860676564Z [2024-02-23 00:27:00,860: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:27:00.864843443Z [2024-02-23 00:27:00,864: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:27:00.884356842Z [2024-02-23 00:27:00,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:27:00.888934642Z [2024-02-23 00:27:00,888: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:27:00.889177099Z [2024-02-23 00:27:00,888: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:27:00.889364980Z [2024-02-23 00:27:00,889: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:27:00.890074723Z [2024-02-23 00:27:00,889: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:27:00.990742039Z [2024-02-23 00:27:00,990: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:27:01.613868614Z [2024-02-23 00:27:01,612: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d8b27b9-09f2-47e9-9141-2a02ee8a376d] succeeded in 1.22046504500031s: None 2024-02-23T00:27:01.907872329Z [2024-02-23 00:27:01,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:27:01.911320844Z [2024-02-23 00:27:01,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:27:01.933433892Z [2024-02-23 00:27:01,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:27:01.934898946Z [2024-02-23 00:27:01,934: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:27:01.934918050Z [2024-02-23 00:27:01,934: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:27:01.935093997Z [2024-02-23 00:27:01,934: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:27:01.935154274Z [2024-02-23 00:27:01,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:27:01.935397116Z [2024-02-23 00:27:01,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:27:01.935422543Z [2024-02-23 00:27:01,935: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:27:01.940284574Z [2024-02-23 00:27:01,939: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:27:01.943788930Z [2024-02-23 00:27:01,943: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:27:01.970155932Z [2024-02-23 00:27:01,969: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:27:01.972911315Z [2024-02-23 00:27:01,972: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:27:01.973110294Z [2024-02-23 00:27:01,972: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:27:01.973423676Z [2024-02-23 00:27:01,973: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:27:01.973616827Z [2024-02-23 00:27:01,973: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:27:01.974118260Z [2024-02-23 00:27:01,973: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:27:01.974340810Z [2024-02-23 00:27:01,973: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:27:02.028947779Z [2024-02-23 00:27:02,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:27:02.075765307Z [2024-02-23 00:27:02,075: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:27:03.612892487Z [2024-02-23 00:27:03,612: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fb170bc-5db7-470a-9f7d-ea973ed722e0] succeeded in 3.225509152000086s: None 2024-02-23T00:27:04.305586156Z [2024-02-23 00:27:04,305: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e103d668-0558-4926-93fa-c6d8e223df28] succeeded in 3.910395136000261s: None 2024-02-23T00:28:00.317615105Z [2024-02-23 00:28:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7252ed54-5e05-46ec-b66c-59b33f8fa225] received 2024-02-23T00:28:00.320950656Z [2024-02-23 00:28:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[895ecf9e-c962-4ef0-8645-0e72eb9a9c82] received 2024-02-23T00:28:00.329825653Z [2024-02-23 00:28:00,329: INFO/ForkPoolWorker-16] [895ecf9e-c962-4ef0-8645-0e72eb9a9c82] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:28:00.335610212Z [2024-02-23 00:28:00,335: INFO/ForkPoolWorker-15] [7252ed54-5e05-46ec-b66c-59b33f8fa225] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:28:00.338799895Z [2024-02-23 00:28:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c417bf17-a77f-470f-ba24-a1901b16561a] received 2024-02-23T00:28:00.341757124Z [2024-02-23 00:28:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a85f06b-f611-4c91-ab51-96820ec326e6] received 2024-02-23T00:28:00.350907239Z [2024-02-23 00:28:00,350: INFO/ForkPoolWorker-2] [4a85f06b-f611-4c91-ab51-96820ec326e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:28:00.352238987Z [2024-02-23 00:28:00,352: INFO/ForkPoolWorker-1] [c417bf17-a77f-470f-ba24-a1901b16561a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:28:00.700041081Z [2024-02-23 00:28:00,696: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:28:00.706564425Z [2024-02-23 00:28:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:28:00.787396036Z [2024-02-23 00:28:00,782: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:28:00.838653286Z [2024-02-23 00:28:00,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:28:00.935619518Z [2024-02-23 00:28:00,935: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:28:00.939426198Z [2024-02-23 00:28:00,938: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:28:00.959114001Z [2024-02-23 00:28:00,958: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:28:00.964755985Z [2024-02-23 00:28:00,964: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:28:00.964820636Z [2024-02-23 00:28:00,964: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:28:00.964874353Z [2024-02-23 00:28:00,964: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:28:00.965058973Z [2024-02-23 00:28:00,964: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:28:01.083312159Z [2024-02-23 00:28:01,082: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:28:01.240238014Z [2024-02-23 00:28:01,239: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:28:01.863101397Z [2024-02-23 00:28:01,862: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[895ecf9e-c962-4ef0-8645-0e72eb9a9c82] succeeded in 1.5401010969999334s: None 2024-02-23T00:28:01.867190203Z [2024-02-23 00:28:01,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7252ed54-5e05-46ec-b66c-59b33f8fa225] succeeded in 1.5438590779999686s: None 2024-02-23T00:28:02.118419768Z [2024-02-23 00:28:02,118: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:28:02.121779613Z [2024-02-23 00:28:02,121: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:28:02.141930170Z [2024-02-23 00:28:02,141: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:28:02.143277669Z [2024-02-23 00:28:02,143: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:28:02.143302349Z [2024-02-23 00:28:02,143: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:28:02.143438373Z [2024-02-23 00:28:02,143: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:28:02.143452759Z [2024-02-23 00:28:02,143: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:28:02.143729079Z [2024-02-23 00:28:02,143: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:28:02.143742891Z [2024-02-23 00:28:02,143: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:28:02.153730341Z [2024-02-23 00:28:02,153: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:28:02.157393989Z [2024-02-23 00:28:02,156: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:28:02.182186976Z [2024-02-23 00:28:02,181: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:28:02.183751701Z [2024-02-23 00:28:02,183: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:28:02.183953891Z [2024-02-23 00:28:02,183: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:28:02.184154375Z [2024-02-23 00:28:02,183: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:28:02.184279924Z [2024-02-23 00:28:02,184: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:28:02.184726564Z [2024-02-23 00:28:02,184: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:28:02.184786454Z [2024-02-23 00:28:02,184: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:28:02.242478255Z [2024-02-23 00:28:02,242: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:28:02.276827148Z [2024-02-23 00:28:02,276: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:28:03.803341286Z [2024-02-23 00:28:03,802: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4a85f06b-f611-4c91-ab51-96820ec326e6] succeeded in 3.458342231000188s: None 2024-02-23T00:28:04.131786890Z [2024-02-23 00:28:04,131: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c417bf17-a77f-470f-ba24-a1901b16561a] succeeded in 3.7909426749997692s: None 2024-02-23T00:29:01.282312461Z [2024-02-23 00:29:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b33773b-f8fe-4ef8-a502-57577b735eb2] received 2024-02-23T00:29:01.286706530Z [2024-02-23 00:29:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82d99090-ae48-4f8b-a262-faa0880cf4e3] received 2024-02-23T00:29:01.290859342Z [2024-02-23 00:29:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1162487d-87df-47e1-b81a-d9d0e9475be8] received 2024-02-23T00:29:01.294268914Z [2024-02-23 00:29:01,293: INFO/ForkPoolWorker-15] [2b33773b-f8fe-4ef8-a502-57577b735eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:29:01.295146679Z [2024-02-23 00:29:01,294: INFO/ForkPoolWorker-16] [82d99090-ae48-4f8b-a262-faa0880cf4e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:29:01.301423341Z [2024-02-23 00:29:01,301: INFO/ForkPoolWorker-1] [1162487d-87df-47e1-b81a-d9d0e9475be8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:29:01.599921509Z [2024-02-23 00:29:01,596: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:29:01.610724838Z [2024-02-23 00:29:01,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:29:01.617841558Z [2024-02-23 00:29:01,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:29:01.827578510Z [2024-02-23 00:29:01,827: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:29:01.831579182Z [2024-02-23 00:29:01,831: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:29:01.852604195Z [2024-02-23 00:29:01,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:29:01.853715661Z [2024-02-23 00:29:01,853: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:29:01.853802143Z [2024-02-23 00:29:01,853: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:29:01.853814922Z [2024-02-23 00:29:01,853: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:29:01.854013621Z [2024-02-23 00:29:01,853: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:29:01.949690178Z [2024-02-23 00:29:01,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:29:02.656960969Z [2024-02-23 00:29:02,656: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b33773b-f8fe-4ef8-a502-57577b735eb2] succeeded in 1.3723381610002434s: None 2024-02-23T00:29:02.814702272Z [2024-02-23 00:29:02,814: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:29:02.818132437Z [2024-02-23 00:29:02,817: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:29:02.839333910Z [2024-02-23 00:29:02,839: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:29:02.841310446Z [2024-02-23 00:29:02,840: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:29:02.841350227Z [2024-02-23 00:29:02,841: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:29:02.841608836Z [2024-02-23 00:29:02,841: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:29:02.841659501Z [2024-02-23 00:29:02,841: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:29:02.841948679Z [2024-02-23 00:29:02,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:29:02.841996807Z [2024-02-23 00:29:02,841: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:29:02.877511193Z [2024-02-23 00:29:02,877: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:29:02.880780323Z [2024-02-23 00:29:02,880: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:29:02.899496460Z [2024-02-23 00:29:02,899: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:29:02.900765766Z [2024-02-23 00:29:02,900: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:29:02.900778716Z [2024-02-23 00:29:02,900: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:29:02.900953225Z [2024-02-23 00:29:02,900: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:29:02.900959637Z [2024-02-23 00:29:02,900: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:29:02.901246777Z [2024-02-23 00:29:02,901: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:29:02.901398207Z [2024-02-23 00:29:02,901: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:29:02.938089778Z [2024-02-23 00:29:02,937: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:29:02.989792420Z [2024-02-23 00:29:02,989: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:29:04.954720354Z [2024-02-23 00:29:04,954: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82d99090-ae48-4f8b-a262-faa0880cf4e3] succeeded in 3.6656546290000733s: None 2024-02-23T00:29:05.546705791Z [2024-02-23 00:29:05,546: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1162487d-87df-47e1-b81a-d9d0e9475be8] succeeded in 4.253792556000008s: None 2024-02-23T00:30:01.244721281Z [2024-02-23 00:30:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78845dd-929d-4421-9217-65016895c6ad] received 2024-02-23T00:30:01.247043823Z [2024-02-23 00:30:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1be771c5-ee5f-43a7-bdd3-bb45bf87ea7e] received 2024-02-23T00:30:01.255640994Z [2024-02-23 00:30:01,255: INFO/ForkPoolWorker-16] [1be771c5-ee5f-43a7-bdd3-bb45bf87ea7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:30:01.256697181Z [2024-02-23 00:30:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f16c9835-0659-4701-a548-22b9b96f3f23] received 2024-02-23T00:30:01.257133217Z [2024-02-23 00:30:01,256: INFO/ForkPoolWorker-15] [c78845dd-929d-4421-9217-65016895c6ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:30:01.265576160Z [2024-02-23 00:30:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce64ee65-3344-4747-8315-07d97cfd566d] received 2024-02-23T00:30:01.271852430Z [2024-02-23 00:30:01,271: INFO/ForkPoolWorker-1] [f16c9835-0659-4701-a548-22b9b96f3f23] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:30:01.273401893Z [2024-02-23 00:30:01,273: INFO/ForkPoolWorker-2] [ce64ee65-3344-4747-8315-07d97cfd566d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:30:01.282728273Z [2024-02-23 00:30:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ad3a18f-bff9-43dd-ab0b-c82f7f7c9dcb] received 2024-02-23T00:30:01.309919801Z [2024-02-23 00:30:01,309: INFO/ForkPoolWorker-3] [8ad3a18f-bff9-43dd-ab0b-c82f7f7c9dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:30:01.709011821Z [2024-02-23 00:30:01,704: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:30:01.729353673Z [2024-02-23 00:30:01,726: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:30:01.829300425Z [2024-02-23 00:30:01,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:30:01.858918600Z [2024-02-23 00:30:01,851: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:30:02.055314371Z [2024-02-23 00:30:02,054: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:30:02.059616209Z [2024-02-23 00:30:02,059: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:02.076295909Z [2024-02-23 00:30:02,069: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:30:02.096100435Z [2024-02-23 00:30:02,095: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:30:02.097495662Z [2024-02-23 00:30:02,097: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:30:02.097711009Z [2024-02-23 00:30:02,097: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:30:02.097915812Z [2024-02-23 00:30:02,097: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:30:02.098227142Z [2024-02-23 00:30:02,098: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:30:02.215592910Z [2024-02-23 00:30:02,215: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:02.612541006Z [2024-02-23 00:30:02,612: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:02.896713130Z [2024-02-23 00:30:02,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f16c9835-0659-4701-a548-22b9b96f3f23] succeeded in 1.6298431509999318s: None 2024-02-23T00:30:03.257793105Z [2024-02-23 00:30:03,257: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ce64ee65-3344-4747-8315-07d97cfd566d] succeeded in 1.9905881290001162s: None 2024-02-23T00:30:03.402964072Z [2024-02-23 00:30:03,402: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:30:03.406307125Z [2024-02-23 00:30:03,405: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:03.441025378Z [2024-02-23 00:30:03,440: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:30:03.447211118Z [2024-02-23 00:30:03,446: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:30:03.447248554Z [2024-02-23 00:30:03,447: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:30:03.447595914Z [2024-02-23 00:30:03,447: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:30:03.447606133Z [2024-02-23 00:30:03,447: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:30:03.447816406Z [2024-02-23 00:30:03,447: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:30:03.447910146Z [2024-02-23 00:30:03,447: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:30:03.473470430Z [2024-02-23 00:30:03,473: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:30:03.477455940Z [2024-02-23 00:30:03,476: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:03.501768427Z [2024-02-23 00:30:03,501: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:30:03.503650031Z [2024-02-23 00:30:03,503: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:30:03.503826095Z [2024-02-23 00:30:03,503: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:30:03.504026064Z [2024-02-23 00:30:03,503: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:30:03.504180311Z [2024-02-23 00:30:03,504: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:30:03.504523822Z [2024-02-23 00:30:03,504: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:30:03.504690738Z [2024-02-23 00:30:03,504: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:30:03.530154126Z [2024-02-23 00:30:03,529: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:03.600757195Z [2024-02-23 00:30:03,600: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:03.603931738Z [2024-02-23 00:30:03,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:30:03.607420066Z [2024-02-23 00:30:03,606: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:03.641146777Z [2024-02-23 00:30:03,640: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:30:03.643199110Z [2024-02-23 00:30:03,642: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:30:03.643339860Z [2024-02-23 00:30:03,643: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:30:03.643448701Z [2024-02-23 00:30:03,643: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:30:03.643485258Z [2024-02-23 00:30:03,643: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:30:03.643742635Z [2024-02-23 00:30:03,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:30:03.643847292Z [2024-02-23 00:30:03,643: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:30:03.752449341Z [2024-02-23 00:30:03,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:04.280102565Z [2024-02-23 00:30:04,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64b2538a-03a7-47fc-a784-8638d41dbf54] received 2024-02-23T00:30:04.294494941Z [2024-02-23 00:30:04,294: INFO/ForkPoolWorker-1] [64b2538a-03a7-47fc-a784-8638d41dbf54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:30:04.372656140Z [2024-02-23 00:30:04,372: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1be771c5-ee5f-43a7-bdd3-bb45bf87ea7e] succeeded in 3.1222183509999013s: None 2024-02-23T00:30:04.686047112Z [2024-02-23 00:30:04,682: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:30:05.099388457Z [2024-02-23 00:30:05,098: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8ad3a18f-bff9-43dd-ab0b-c82f7f7c9dcb] succeeded in 3.812431505999939s: None 2024-02-23T00:30:05.715981123Z [2024-02-23 00:30:05,715: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c78845dd-929d-4421-9217-65016895c6ad] succeeded in 4.467490543000167s: None 2024-02-23T00:30:05.982988512Z [2024-02-23 00:30:05,982: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:30:05.987130044Z [2024-02-23 00:30:05,986: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:06.011472380Z [2024-02-23 00:30:06,011: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:30:06.012932610Z [2024-02-23 00:30:06,012: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:30:06.012967732Z [2024-02-23 00:30:06,012: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:30:06.013150354Z [2024-02-23 00:30:06,012: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:30:06.013213487Z [2024-02-23 00:30:06,013: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:30:06.013711570Z [2024-02-23 00:30:06,013: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:30:06.013805858Z [2024-02-23 00:30:06,013: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:30:06.104070931Z [2024-02-23 00:30:06,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:06.824624590Z [2024-02-23 00:30:06,823: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64b2538a-03a7-47fc-a784-8638d41dbf54] succeeded in 2.5412813140001163s: None 2024-02-23T00:30:07.838128439Z [2024-02-23 00:30:07,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62f4523d-c340-40a7-81ca-77060fd26344] received 2024-02-23T00:30:07.850247663Z [2024-02-23 00:30:07,849: INFO/ForkPoolWorker-15] [62f4523d-c340-40a7-81ca-77060fd26344] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:30:08.179077826Z [2024-02-23 00:30:08,175: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:30:09.368728344Z [2024-02-23 00:30:09,368: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:30:09.372163071Z [2024-02-23 00:30:09,371: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:09.392525430Z [2024-02-23 00:30:09,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:30:09.393982267Z [2024-02-23 00:30:09,393: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:30:09.394071376Z [2024-02-23 00:30:09,393: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:30:09.394330092Z [2024-02-23 00:30:09,394: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:30:09.394493336Z [2024-02-23 00:30:09,394: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:30:09.394915803Z [2024-02-23 00:30:09,394: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:30:09.395086490Z [2024-02-23 00:30:09,394: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:30:09.476635006Z [2024-02-23 00:30:09,476: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:10.043146001Z [2024-02-23 00:30:10,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62f4523d-c340-40a7-81ca-77060fd26344] succeeded in 2.2028373660000398s: None 2024-02-23T00:30:10.312707839Z [2024-02-23 00:30:10,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56b9d34a-cad6-483b-9849-f8dfb3dd814e] received 2024-02-23T00:30:10.336094226Z [2024-02-23 00:30:10,335: INFO/ForkPoolWorker-15] [56b9d34a-cad6-483b-9849-f8dfb3dd814e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:30:10.696264945Z [2024-02-23 00:30:10,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:30:11.822324818Z [2024-02-23 00:30:11,821: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:30:11.825935546Z [2024-02-23 00:30:11,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:30:11.843564095Z [2024-02-23 00:30:11,843: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:30:11.844782400Z [2024-02-23 00:30:11,844: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:30:11.844885440Z [2024-02-23 00:30:11,844: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:30:11.845043406Z [2024-02-23 00:30:11,844: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:30:11.845156319Z [2024-02-23 00:30:11,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:30:11.845436411Z [2024-02-23 00:30:11,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:30:11.845509640Z [2024-02-23 00:30:11,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:30:11.917829318Z [2024-02-23 00:30:11,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:30:12.444029133Z [2024-02-23 00:30:12,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56b9d34a-cad6-483b-9849-f8dfb3dd814e] succeeded in 2.123948116000065s: None 2024-02-23T00:31:00.371090233Z [2024-02-23 00:31:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c2a81a4-b2d5-4701-bfca-34ff2b9860a7] received 2024-02-23T00:31:00.381758226Z [2024-02-23 00:31:00,381: INFO/ForkPoolWorker-15] [6c2a81a4-b2d5-4701-bfca-34ff2b9860a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:31:00.384798930Z [2024-02-23 00:31:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a1c2ca3-fed4-4df2-a959-279012c97db0] received 2024-02-23T00:31:00.391832862Z [2024-02-23 00:31:00,391: INFO/ForkPoolWorker-16] [8a1c2ca3-fed4-4df2-a959-279012c97db0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:31:00.394634786Z [2024-02-23 00:31:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14fca3a0-763e-4037-ab5d-ad2a8eb1ea07] received 2024-02-23T00:31:00.406659808Z [2024-02-23 00:31:00,406: INFO/ForkPoolWorker-1] [14fca3a0-763e-4037-ab5d-ad2a8eb1ea07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:31:00.715521946Z [2024-02-23 00:31:00,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:31:00.730944674Z [2024-02-23 00:31:00,727: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:31:00.742757614Z [2024-02-23 00:31:00,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:31:00.927040084Z [2024-02-23 00:31:00,926: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:31:00.931000590Z [2024-02-23 00:31:00,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:31:00.968606882Z [2024-02-23 00:31:00,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:31:00.975219653Z [2024-02-23 00:31:00,974: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:31:00.975435492Z [2024-02-23 00:31:00,975: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:31:00.975561827Z [2024-02-23 00:31:00,975: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:31:00.975822933Z [2024-02-23 00:31:00,975: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:31:01.078869251Z [2024-02-23 00:31:01,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:31:01.825435508Z [2024-02-23 00:31:01,825: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a1c2ca3-fed4-4df2-a959-279012c97db0] succeeded in 1.4393166609997934s: None 2024-02-23T00:31:02.050377462Z [2024-02-23 00:31:02,050: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:31:02.053824289Z [2024-02-23 00:31:02,053: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:31:02.092715941Z [2024-02-23 00:31:02,092: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:31:02.094210566Z [2024-02-23 00:31:02,093: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:31:02.094344698Z [2024-02-23 00:31:02,094: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:31:02.094532608Z [2024-02-23 00:31:02,094: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:31:02.094649808Z [2024-02-23 00:31:02,094: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:31:02.095023245Z [2024-02-23 00:31:02,094: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:31:02.095169301Z [2024-02-23 00:31:02,095: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:31:02.196649526Z [2024-02-23 00:31:02,196: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:31:02.263055327Z [2024-02-23 00:31:02,262: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:31:02.268051641Z [2024-02-23 00:31:02,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:31:02.291774452Z [2024-02-23 00:31:02,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:31:02.293018025Z [2024-02-23 00:31:02,292: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:31:02.293038079Z [2024-02-23 00:31:02,292: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:31:02.293166772Z [2024-02-23 00:31:02,293: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:31:02.293196499Z [2024-02-23 00:31:02,293: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:31:02.293484713Z [2024-02-23 00:31:02,293: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:31:02.293538012Z [2024-02-23 00:31:02,293: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:31:02.378521237Z [2024-02-23 00:31:02,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:31:03.957505370Z [2024-02-23 00:31:03,957: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c2a81a4-b2d5-4701-bfca-34ff2b9860a7] succeeded in 3.584947327000009s: None 2024-02-23T00:31:04.228632762Z [2024-02-23 00:31:04,227: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[14fca3a0-763e-4037-ab5d-ad2a8eb1ea07] succeeded in 3.830201818000205s: None 2024-02-23T00:32:00.567664317Z [2024-02-23 00:32:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2e5f5b0-3a37-44ab-9514-8e39485ed64b] received 2024-02-23T00:32:00.591456045Z [2024-02-23 00:32:00,591: INFO/ForkPoolWorker-15] [f2e5f5b0-3a37-44ab-9514-8e39485ed64b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:32:00.621382403Z [2024-02-23 00:32:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a9fb72b-453e-445e-96fc-4a8b0815be6b] received 2024-02-23T00:32:00.626698729Z [2024-02-23 00:32:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6922aff6-92ca-4939-9e49-dde242d13e9c] received 2024-02-23T00:32:00.644595261Z [2024-02-23 00:32:00,644: INFO/ForkPoolWorker-1] [6922aff6-92ca-4939-9e49-dde242d13e9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:32:00.648173759Z [2024-02-23 00:32:00,644: INFO/ForkPoolWorker-16] [4a9fb72b-453e-445e-96fc-4a8b0815be6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:32:01.020118916Z [2024-02-23 00:32:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6252146-2487-45c3-8414-232470408732] received 2024-02-23T00:32:01.045651697Z [2024-02-23 00:32:01,045: INFO/ForkPoolWorker-2] [a6252146-2487-45c3-8414-232470408732] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:32:01.148358475Z [2024-02-23 00:32:01,144: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:32:01.180222709Z [2024-02-23 00:32:01,176: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:32:01.276810497Z [2024-02-23 00:32:01,270: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:32:01.499736185Z [2024-02-23 00:32:01,499: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:32:01.503775241Z [2024-02-23 00:32:01,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:32:01.524244085Z [2024-02-23 00:32:01,524: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:32:01.526108603Z [2024-02-23 00:32:01,525: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:32:01.526311176Z [2024-02-23 00:32:01,526: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:32:01.526452790Z [2024-02-23 00:32:01,526: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:32:01.526704675Z [2024-02-23 00:32:01,526: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:32:01.563619428Z [2024-02-23 00:32:01,558: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:32:01.630249423Z [2024-02-23 00:32:01,629: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:32:01.706089992Z [2024-02-23 00:32:01,705: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:32:02.387818838Z [2024-02-23 00:32:02,387: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a9fb72b-453e-445e-96fc-4a8b0815be6b] succeeded in 1.7639276140007496s: None 2024-02-23T00:32:02.483218399Z [2024-02-23 00:32:02,482: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2e5f5b0-3a37-44ab-9514-8e39485ed64b] succeeded in 1.9120880120008223s: None 2024-02-23T00:32:02.636902306Z [2024-02-23 00:32:02,636: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:32:02.640147362Z [2024-02-23 00:32:02,639: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:32:02.665174772Z [2024-02-23 00:32:02,664: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:32:02.667276695Z [2024-02-23 00:32:02,666: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:32:02.667342069Z [2024-02-23 00:32:02,667: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:32:02.667563104Z [2024-02-23 00:32:02,667: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:32:02.667615368Z [2024-02-23 00:32:02,667: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:32:02.668475909Z [2024-02-23 00:32:02,668: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:32:02.668526968Z [2024-02-23 00:32:02,668: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:32:02.769493061Z [2024-02-23 00:32:02,769: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:32:03.234977405Z [2024-02-23 00:32:03,234: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:32:03.239810011Z [2024-02-23 00:32:03,239: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:32:03.263398732Z [2024-02-23 00:32:03,263: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:32:03.265545883Z [2024-02-23 00:32:03,265: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:32:03.265755180Z [2024-02-23 00:32:03,265: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:32:03.266022467Z [2024-02-23 00:32:03,265: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:32:03.266188271Z [2024-02-23 00:32:03,265: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:32:03.266635452Z [2024-02-23 00:32:03,266: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:32:03.266763351Z [2024-02-23 00:32:03,266: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:32:03.355897574Z [2024-02-23 00:32:03,355: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:32:04.822958573Z [2024-02-23 00:32:04,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6922aff6-92ca-4939-9e49-dde242d13e9c] succeeded in 4.189202670000668s: None 2024-02-23T00:32:06.356764328Z [2024-02-23 00:32:06,356: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a6252146-2487-45c3-8414-232470408732] succeeded in 5.330410679999659s: None 2024-02-23T00:33:00.828654921Z [2024-02-23 00:33:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5afb4e1-d52e-4297-a215-2f9f0ae25b4a] received 2024-02-23T00:33:00.830419461Z [2024-02-23 00:33:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87c6d2ad-23e5-4556-8fba-62a2d8f7bab7] received 2024-02-23T00:33:00.841451464Z [2024-02-23 00:33:00,841: INFO/ForkPoolWorker-16] [87c6d2ad-23e5-4556-8fba-62a2d8f7bab7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:33:00.841945840Z [2024-02-23 00:33:00,841: INFO/ForkPoolWorker-15] [d5afb4e1-d52e-4297-a215-2f9f0ae25b4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:33:00.845002725Z [2024-02-23 00:33:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f5e8735-ab22-4b05-a0f5-8492d68b280b] received 2024-02-23T00:33:00.853265316Z [2024-02-23 00:33:00,853: INFO/ForkPoolWorker-1] [4f5e8735-ab22-4b05-a0f5-8492d68b280b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:33:01.155746279Z [2024-02-23 00:33:01,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:33:01.176920710Z [2024-02-23 00:33:01,173: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:33:01.178215778Z [2024-02-23 00:33:01,175: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:33:01.332966111Z [2024-02-23 00:33:01,332: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:33:01.336643866Z [2024-02-23 00:33:01,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:33:01.366391416Z [2024-02-23 00:33:01,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:33:01.371984535Z [2024-02-23 00:33:01,371: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:33:01.372063915Z [2024-02-23 00:33:01,371: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:33:01.372163619Z [2024-02-23 00:33:01,372: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:33:01.372425084Z [2024-02-23 00:33:01,372: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:33:01.513857703Z [2024-02-23 00:33:01,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:33:02.169284408Z [2024-02-23 00:33:02,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87c6d2ad-23e5-4556-8fba-62a2d8f7bab7] succeeded in 1.3363582840001982s: None 2024-02-23T00:33:02.332938146Z [2024-02-23 00:33:02,332: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:33:02.342319029Z [2024-02-23 00:33:02,340: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:33:02.396371455Z [2024-02-23 00:33:02,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:33:02.399542281Z [2024-02-23 00:33:02,399: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:33:02.399784676Z [2024-02-23 00:33:02,399: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:33:02.400043112Z [2024-02-23 00:33:02,399: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:33:02.400231447Z [2024-02-23 00:33:02,400: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:33:02.400640869Z [2024-02-23 00:33:02,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:33:02.407224627Z [2024-02-23 00:33:02,406: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:33:02.510208113Z [2024-02-23 00:33:02,509: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:33:02.513582116Z [2024-02-23 00:33:02,513: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:33:02.539526884Z [2024-02-23 00:33:02,539: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:33:02.544320182Z [2024-02-23 00:33:02,544: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:33:02.547727242Z [2024-02-23 00:33:02,547: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:33:02.547787905Z [2024-02-23 00:33:02,547: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:33:02.547865257Z [2024-02-23 00:33:02,547: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:33:02.547916334Z [2024-02-23 00:33:02,547: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:33:02.548179861Z [2024-02-23 00:33:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:33:02.548250463Z [2024-02-23 00:33:02,548: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:33:02.643883569Z [2024-02-23 00:33:02,643: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:33:04.225724815Z [2024-02-23 00:33:04,225: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5afb4e1-d52e-4297-a215-2f9f0ae25b4a] succeeded in 3.3943915060008294s: None 2024-02-23T00:33:04.923950040Z [2024-02-23 00:33:04,923: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4f5e8735-ab22-4b05-a0f5-8492d68b280b] succeeded in 4.076176469000529s: None 2024-02-23T00:34:00.407041677Z [2024-02-23 00:34:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[843f5359-93ba-4d45-a01f-1b72569e5e73] received 2024-02-23T00:34:00.411992587Z [2024-02-23 00:34:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[816c6f06-a9b9-4b8b-9b63-53a704e95d58] received 2024-02-23T00:34:00.416768103Z [2024-02-23 00:34:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0294800c-1d7f-4334-a89d-f2c7e73d5dbf] received 2024-02-23T00:34:00.424173531Z [2024-02-23 00:34:00,417: INFO/ForkPoolWorker-15] [843f5359-93ba-4d45-a01f-1b72569e5e73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:34:00.428161117Z [2024-02-23 00:34:00,427: INFO/ForkPoolWorker-16] [816c6f06-a9b9-4b8b-9b63-53a704e95d58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:34:00.429756125Z [2024-02-23 00:34:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be3f172b-a4fd-4cff-a37a-aa5514be84aa] received 2024-02-23T00:34:00.435033662Z [2024-02-23 00:34:00,434: INFO/ForkPoolWorker-1] [0294800c-1d7f-4334-a89d-f2c7e73d5dbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:34:00.436308090Z [2024-02-23 00:34:00,436: INFO/ForkPoolWorker-2] [be3f172b-a4fd-4cff-a37a-aa5514be84aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:34:00.749115972Z [2024-02-23 00:34:00,745: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:34:00.843815867Z [2024-02-23 00:34:00,840: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:34:00.873222379Z [2024-02-23 00:34:00,869: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:34:00.880211097Z [2024-02-23 00:34:00,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:34:00.913650218Z [2024-02-23 00:34:00,913: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:34:00.919080048Z [2024-02-23 00:34:00,918: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:34:00.942929046Z [2024-02-23 00:34:00,942: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:34:00.944015531Z [2024-02-23 00:34:00,943: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:34:00.944175345Z [2024-02-23 00:34:00,943: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:34:00.944209927Z [2024-02-23 00:34:00,944: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:34:00.944481564Z [2024-02-23 00:34:00,944: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:34:01.039379824Z [2024-02-23 00:34:01,039: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:34:01.136593351Z [2024-02-23 00:34:01,136: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:34:01.638806757Z [2024-02-23 00:34:01,638: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[be3f172b-a4fd-4cff-a37a-aa5514be84aa] succeeded in 1.2073207659996115s: None 2024-02-23T00:34:01.804531164Z [2024-02-23 00:34:01,804: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0294800c-1d7f-4334-a89d-f2c7e73d5dbf] succeeded in 1.3852364779995696s: None 2024-02-23T00:34:02.173982798Z [2024-02-23 00:34:02,173: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:34:02.177535741Z [2024-02-23 00:34:02,177: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:34:02.205317228Z [2024-02-23 00:34:02,205: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:34:02.207400879Z [2024-02-23 00:34:02,207: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:34:02.207418148Z [2024-02-23 00:34:02,207: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:34:02.207936004Z [2024-02-23 00:34:02,207: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:34:02.208153480Z [2024-02-23 00:34:02,207: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:34:02.209419301Z [2024-02-23 00:34:02,209: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:34:02.209432947Z [2024-02-23 00:34:02,209: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:34:02.267646616Z [2024-02-23 00:34:02,266: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:34:02.271350066Z [2024-02-23 00:34:02,270: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:34:02.294219978Z [2024-02-23 00:34:02,293: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:34:02.298590947Z [2024-02-23 00:34:02,298: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:34:02.298714993Z [2024-02-23 00:34:02,298: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:34:02.299001231Z [2024-02-23 00:34:02,298: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:34:02.299162485Z [2024-02-23 00:34:02,298: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:34:02.299583432Z [2024-02-23 00:34:02,299: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:34:02.299668403Z [2024-02-23 00:34:02,299: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:34:02.310676555Z [2024-02-23 00:34:02,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:34:02.431207803Z [2024-02-23 00:34:02,430: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:34:04.458015879Z [2024-02-23 00:34:04,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[843f5359-93ba-4d45-a01f-1b72569e5e73] succeeded in 4.048247064999487s: None 2024-02-23T00:34:05.095192975Z [2024-02-23 00:34:05,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[816c6f06-a9b9-4b8b-9b63-53a704e95d58] succeeded in 4.677672131000691s: None 2024-02-23T00:35:00.294514403Z [2024-02-23 00:35:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0192b062-72fc-4267-8080-9068463f0bb0] received 2024-02-23T00:35:00.301839338Z [2024-02-23 00:35:00,301: INFO/ForkPoolWorker-15] [0192b062-72fc-4267-8080-9068463f0bb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:35:00.305254329Z [2024-02-23 00:35:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe453be7-37e6-46eb-bb2b-b4e110e87fc7] received 2024-02-23T00:35:00.309367251Z [2024-02-23 00:35:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54511e0d-6a9b-475f-aa99-d0d6d9a466cc] received 2024-02-23T00:35:00.315072651Z [2024-02-23 00:35:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e821fd2-e6ca-407c-8969-5f7974cad4e5] received 2024-02-23T00:35:00.319751022Z [2024-02-23 00:35:00,319: INFO/ForkPoolWorker-16] [fe453be7-37e6-46eb-bb2b-b4e110e87fc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:35:00.326742011Z [2024-02-23 00:35:00,326: INFO/ForkPoolWorker-1] [54511e0d-6a9b-475f-aa99-d0d6d9a466cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:35:00.327556776Z [2024-02-23 00:35:00,327: INFO/ForkPoolWorker-2] [0e821fd2-e6ca-407c-8969-5f7974cad4e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:35:00.608326441Z [2024-02-23 00:35:00,605: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:35:00.645458012Z [2024-02-23 00:35:00,642: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:35:00.672614899Z [2024-02-23 00:35:00,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:35:00.779767741Z [2024-02-23 00:35:00,776: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:35:00.861892437Z [2024-02-23 00:35:00,861: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:35:00.867970379Z [2024-02-23 00:35:00,867: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:00.891207842Z [2024-02-23 00:35:00,890: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:35:00.892192820Z [2024-02-23 00:35:00,891: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:35:00.892286017Z [2024-02-23 00:35:00,892: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:35:00.892383715Z [2024-02-23 00:35:00,892: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:35:00.892953581Z [2024-02-23 00:35:00,892: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:35:00.993037151Z [2024-02-23 00:35:00,992: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:01.556675285Z [2024-02-23 00:35:01,556: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54511e0d-6a9b-475f-aa99-d0d6d9a466cc] succeeded in 1.2444352219999928s: None 2024-02-23T00:35:01.956435548Z [2024-02-23 00:35:01,955: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:35:01.962513689Z [2024-02-23 00:35:01,961: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:01.996396514Z [2024-02-23 00:35:01,996: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:35:01.998207336Z [2024-02-23 00:35:01,997: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:35:01.998222855Z [2024-02-23 00:35:01,998: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:35:01.998378017Z [2024-02-23 00:35:01,998: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:35:01.998434050Z [2024-02-23 00:35:01,998: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:35:01.998793163Z [2024-02-23 00:35:01,998: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:35:01.999318634Z [2024-02-23 00:35:01,998: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:35:02.039753921Z [2024-02-23 00:35:02,039: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:35:02.043148695Z [2024-02-23 00:35:02,042: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:02.065918742Z [2024-02-23 00:35:02,065: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:35:02.067482552Z [2024-02-23 00:35:02,067: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:35:02.068210944Z [2024-02-23 00:35:02,068: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:35:02.068567375Z [2024-02-23 00:35:02,068: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:35:02.068814797Z [2024-02-23 00:35:02,068: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:35:02.069258843Z [2024-02-23 00:35:02,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:35:02.069499228Z [2024-02-23 00:35:02,069: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:35:02.092228268Z [2024-02-23 00:35:02,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:02.106410108Z [2024-02-23 00:35:02,105: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:35:02.110247783Z [2024-02-23 00:35:02,109: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:02.157844800Z [2024-02-23 00:35:02,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:02.160608654Z [2024-02-23 00:35:02,160: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:35:02.163709969Z [2024-02-23 00:35:02,163: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:35:02.163891128Z [2024-02-23 00:35:02,163: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:35:02.164086683Z [2024-02-23 00:35:02,163: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:35:02.164201248Z [2024-02-23 00:35:02,164: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:35:02.164885180Z [2024-02-23 00:35:02,164: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:35:02.167579072Z [2024-02-23 00:35:02,167: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:35:02.314843769Z [2024-02-23 00:35:02,314: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:02.837043114Z [2024-02-23 00:35:02,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0192b062-72fc-4267-8080-9068463f0bb0] succeeded in 2.5407847180003955s: None 2024-02-23T00:35:02.887246225Z [2024-02-23 00:35:02,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6753983-1e4a-44a1-b8a8-969181988c67] received 2024-02-23T00:35:02.897923605Z [2024-02-23 00:35:02,897: INFO/ForkPoolWorker-15] [e6753983-1e4a-44a1-b8a8-969181988c67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:35:03.207667371Z [2024-02-23 00:35:03,204: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:35:03.784902852Z [2024-02-23 00:35:03,784: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e821fd2-e6ca-407c-8969-5f7974cad4e5] succeeded in 3.4647162900000694s: None 2024-02-23T00:35:03.968342824Z [2024-02-23 00:35:03,967: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe453be7-37e6-46eb-bb2b-b4e110e87fc7] succeeded in 3.6577641539997785s: None 2024-02-23T00:35:04.511234277Z [2024-02-23 00:35:04,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:35:04.514996754Z [2024-02-23 00:35:04,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:04.540622012Z [2024-02-23 00:35:04,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:35:04.542259103Z [2024-02-23 00:35:04,541: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:35:04.542310510Z [2024-02-23 00:35:04,542: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:35:04.542478479Z [2024-02-23 00:35:04,542: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:35:04.542527506Z [2024-02-23 00:35:04,542: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:35:04.542956232Z [2024-02-23 00:35:04,542: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:35:04.542994956Z [2024-02-23 00:35:04,542: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:35:04.629134741Z [2024-02-23 00:35:04,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:05.299874029Z [2024-02-23 00:35:05,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04000dfe-e8f2-4000-94cb-b6154223a650] received 2024-02-23T00:35:05.312816503Z [2024-02-23 00:35:05,312: INFO/ForkPoolWorker-16] [04000dfe-e8f2-4000-94cb-b6154223a650] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:35:05.358534032Z [2024-02-23 00:35:05,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6753983-1e4a-44a1-b8a8-969181988c67] succeeded in 2.4679628349995255s: None 2024-02-23T00:35:05.604891200Z [2024-02-23 00:35:05,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:35:06.732967183Z [2024-02-23 00:35:06,732: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:35:06.736416343Z [2024-02-23 00:35:06,735: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:06.765483493Z [2024-02-23 00:35:06,765: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:35:06.767173148Z [2024-02-23 00:35:06,766: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:35:06.767299881Z [2024-02-23 00:35:06,767: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:35:06.767484795Z [2024-02-23 00:35:06,767: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:35:06.767596410Z [2024-02-23 00:35:06,767: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:35:06.768005718Z [2024-02-23 00:35:06,767: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:35:06.768138388Z [2024-02-23 00:35:06,768: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:35:06.864036437Z [2024-02-23 00:35:06,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:10.066592600Z [2024-02-23 00:35:10,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d10681fd-f499-43d4-9ec0-d1f20936e782] received 2024-02-23T00:35:10.074286997Z [2024-02-23 00:35:10,074: INFO/ForkPoolWorker-15] [d10681fd-f499-43d4-9ec0-d1f20936e782] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:35:10.171107153Z [2024-02-23 00:35:10,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04000dfe-e8f2-4000-94cb-b6154223a650] succeeded in 4.864240431000326s: None 2024-02-23T00:35:10.426110109Z [2024-02-23 00:35:10,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:35:11.566005182Z [2024-02-23 00:35:11,565: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:35:11.569492192Z [2024-02-23 00:35:11,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:35:11.589041450Z [2024-02-23 00:35:11,588: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:35:11.590283312Z [2024-02-23 00:35:11,590: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:35:11.590357498Z [2024-02-23 00:35:11,590: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:35:11.590518326Z [2024-02-23 00:35:11,590: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:35:11.590578627Z [2024-02-23 00:35:11,590: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:35:11.590888070Z [2024-02-23 00:35:11,590: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:35:11.590977742Z [2024-02-23 00:35:11,590: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:35:11.671253408Z [2024-02-23 00:35:11,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:35:12.342702434Z [2024-02-23 00:35:12,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d10681fd-f499-43d4-9ec0-d1f20936e782] succeeded in 2.274557368000387s: None 2024-02-23T00:36:00.736825188Z [2024-02-23 00:36:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[272e47c6-4ad8-452e-8411-ad2020389bd2] received 2024-02-23T00:36:00.740699023Z [2024-02-23 00:36:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bc031de-23de-448c-b02b-83f99421df8a] received 2024-02-23T00:36:00.744376701Z [2024-02-23 00:36:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e5c65ec-b641-4f1e-8e01-3602f76d97b2] received 2024-02-23T00:36:00.754050320Z [2024-02-23 00:36:00,753: INFO/ForkPoolWorker-16] [2bc031de-23de-448c-b02b-83f99421df8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:36:00.754592840Z [2024-02-23 00:36:00,754: INFO/ForkPoolWorker-1] [4e5c65ec-b641-4f1e-8e01-3602f76d97b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:36:00.755655105Z [2024-02-23 00:36:00,755: INFO/ForkPoolWorker-15] [272e47c6-4ad8-452e-8411-ad2020389bd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:36:00.759016198Z [2024-02-23 00:36:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deac273f-75d6-456d-9ebe-748427621e86] received 2024-02-23T00:36:00.766737585Z [2024-02-23 00:36:00,766: INFO/ForkPoolWorker-2] [deac273f-75d6-456d-9ebe-748427621e86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:36:01.065659393Z [2024-02-23 00:36:01,062: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:36:01.118655555Z [2024-02-23 00:36:01,114: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:36:01.155535126Z [2024-02-23 00:36:01,151: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:36:01.178262022Z [2024-02-23 00:36:01,175: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:36:01.281265737Z [2024-02-23 00:36:01,280: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:36:01.286707807Z [2024-02-23 00:36:01,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:36:01.313862567Z [2024-02-23 00:36:01,313: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:36:01.315126128Z [2024-02-23 00:36:01,314: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:36:01.315300230Z [2024-02-23 00:36:01,315: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:36:01.315419149Z [2024-02-23 00:36:01,315: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:36:01.315718250Z [2024-02-23 00:36:01,315: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:36:01.427999556Z [2024-02-23 00:36:01,427: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:36:01.472566144Z [2024-02-23 00:36:01,472: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:36:02.073353483Z [2024-02-23 00:36:02,072: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e5c65ec-b641-4f1e-8e01-3602f76d97b2] succeeded in 1.3275810099994487s: None 2024-02-23T00:36:02.177642773Z [2024-02-23 00:36:02,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[272e47c6-4ad8-452e-8411-ad2020389bd2] succeeded in 1.4364860430005137s: None 2024-02-23T00:36:02.443088824Z [2024-02-23 00:36:02,442: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:36:02.446418689Z [2024-02-23 00:36:02,445: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:36:02.474325741Z [2024-02-23 00:36:02,474: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:36:02.476346036Z [2024-02-23 00:36:02,476: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:36:02.476490139Z [2024-02-23 00:36:02,476: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:36:02.476760573Z [2024-02-23 00:36:02,476: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:36:02.476931007Z [2024-02-23 00:36:02,476: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:36:02.477357371Z [2024-02-23 00:36:02,477: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:36:02.477476508Z [2024-02-23 00:36:02,477: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:36:02.502577732Z [2024-02-23 00:36:02,502: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:36:02.506282436Z [2024-02-23 00:36:02,505: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:36:02.527713264Z [2024-02-23 00:36:02,527: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:36:02.529043451Z [2024-02-23 00:36:02,528: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:36:02.529194732Z [2024-02-23 00:36:02,528: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:36:02.529403946Z [2024-02-23 00:36:02,529: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:36:02.529515641Z [2024-02-23 00:36:02,529: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:36:02.529826133Z [2024-02-23 00:36:02,529: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:36:02.529961641Z [2024-02-23 00:36:02,529: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:36:02.588016397Z [2024-02-23 00:36:02,587: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:36:02.628436473Z [2024-02-23 00:36:02,628: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:36:04.128809456Z [2024-02-23 00:36:04,128: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[deac273f-75d6-456d-9ebe-748427621e86] succeeded in 3.3676157410000087s: None 2024-02-23T00:36:04.693290768Z [2024-02-23 00:36:04,691: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2bc031de-23de-448c-b02b-83f99421df8a] succeeded in 3.948932416000389s: None 2024-02-23T00:37:00.963933417Z [2024-02-23 00:37:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[139b38c3-0e4b-45ca-80eb-e8dcea0cee37] received 2024-02-23T00:37:00.965988637Z [2024-02-23 00:37:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c16edc82-8c8f-480c-9f1f-60cafd95fd62] received 2024-02-23T00:37:00.970190180Z [2024-02-23 00:37:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[053e2a5b-5afb-434b-ba1e-567a319e246e] received 2024-02-23T00:37:00.981290695Z [2024-02-23 00:37:00,981: INFO/ForkPoolWorker-1] [053e2a5b-5afb-434b-ba1e-567a319e246e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:37:00.983468574Z [2024-02-23 00:37:00,983: INFO/ForkPoolWorker-16] [c16edc82-8c8f-480c-9f1f-60cafd95fd62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:37:00.984336496Z [2024-02-23 00:37:00,984: INFO/ForkPoolWorker-15] [139b38c3-0e4b-45ca-80eb-e8dcea0cee37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:37:01.286797505Z [2024-02-23 00:37:01,283: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:37:01.317736735Z [2024-02-23 00:37:01,313: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:37:01.321660431Z [2024-02-23 00:37:01,318: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:37:01.514603333Z [2024-02-23 00:37:01,514: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:37:01.518431721Z [2024-02-23 00:37:01,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:37:01.550025548Z [2024-02-23 00:37:01,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:37:01.551547895Z [2024-02-23 00:37:01,551: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:37:01.551763666Z [2024-02-23 00:37:01,551: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:37:01.551978136Z [2024-02-23 00:37:01,551: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:37:01.552460695Z [2024-02-23 00:37:01,552: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:37:01.655791380Z [2024-02-23 00:37:01,655: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:37:02.338494220Z [2024-02-23 00:37:02,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[139b38c3-0e4b-45ca-80eb-e8dcea0cee37] succeeded in 1.3671499780002705s: None 2024-02-23T00:37:02.549383829Z [2024-02-23 00:37:02,549: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:37:02.552862096Z [2024-02-23 00:37:02,552: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:37:02.576228739Z [2024-02-23 00:37:02,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:37:02.578101432Z [2024-02-23 00:37:02,577: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:37:02.578348104Z [2024-02-23 00:37:02,578: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:37:02.578565266Z [2024-02-23 00:37:02,578: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:37:02.578720601Z [2024-02-23 00:37:02,578: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:37:02.579266356Z [2024-02-23 00:37:02,579: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:37:02.579357661Z [2024-02-23 00:37:02,579: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:37:02.624026498Z [2024-02-23 00:37:02,623: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:37:02.627409491Z [2024-02-23 00:37:02,626: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:37:02.657008193Z [2024-02-23 00:37:02,656: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:37:02.659746897Z [2024-02-23 00:37:02,659: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:37:02.659867845Z [2024-02-23 00:37:02,659: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:37:02.660228473Z [2024-02-23 00:37:02,659: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:37:02.660387213Z [2024-02-23 00:37:02,660: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:37:02.660891827Z [2024-02-23 00:37:02,660: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:37:02.661050444Z [2024-02-23 00:37:02,660: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:37:02.672011394Z [2024-02-23 00:37:02,671: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:37:02.749649342Z [2024-02-23 00:37:02,749: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:37:04.674510773Z [2024-02-23 00:37:04,674: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[053e2a5b-5afb-434b-ba1e-567a319e246e] succeeded in 3.7027657190001264s: None 2024-02-23T00:37:05.268774785Z [2024-02-23 00:37:05,268: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c16edc82-8c8f-480c-9f1f-60cafd95fd62] succeeded in 4.299343505999786s: None 2024-02-23T00:38:00.863624918Z [2024-02-23 00:38:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fff0a41-9e30-400e-802e-863b510eee44] received 2024-02-23T00:38:00.873747548Z [2024-02-23 00:38:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40c6f503-5755-4249-a9ed-9e73e0c33bf3] received 2024-02-23T00:38:00.877968665Z [2024-02-23 00:38:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[427e7645-d624-44d4-a08f-6ccb253768fd] received 2024-02-23T00:38:00.882373422Z [2024-02-23 00:38:00,880: INFO/ForkPoolWorker-15] [1fff0a41-9e30-400e-802e-863b510eee44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:38:00.882430889Z [2024-02-23 00:38:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[646e638f-d30b-4faf-9fd5-d2c2d4a49d3a] received 2024-02-23T00:38:00.892969590Z [2024-02-23 00:38:00,892: INFO/ForkPoolWorker-1] [427e7645-d624-44d4-a08f-6ccb253768fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:38:00.893771283Z [2024-02-23 00:38:00,893: INFO/ForkPoolWorker-16] [40c6f503-5755-4249-a9ed-9e73e0c33bf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:38:00.906750481Z [2024-02-23 00:38:00,906: INFO/ForkPoolWorker-2] [646e638f-d30b-4faf-9fd5-d2c2d4a49d3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:38:01.213973412Z [2024-02-23 00:38:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:38:01.221245929Z [2024-02-23 00:38:01,217: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:38:01.225326940Z [2024-02-23 00:38:01,222: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:38:01.378335235Z [2024-02-23 00:38:01,374: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:38:01.494142078Z [2024-02-23 00:38:01,493: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:38:01.583504311Z [2024-02-23 00:38:01,582: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:38:01.591964302Z [2024-02-23 00:38:01,591: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:38:01.650127096Z [2024-02-23 00:38:01,649: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:38:01.654376579Z [2024-02-23 00:38:01,654: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:38:01.654709343Z [2024-02-23 00:38:01,654: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:38:01.654786356Z [2024-02-23 00:38:01,654: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:38:01.655107577Z [2024-02-23 00:38:01,654: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:38:01.829975221Z [2024-02-23 00:38:01,829: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:38:02.147293452Z [2024-02-23 00:38:02,146: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[427e7645-d624-44d4-a08f-6ccb253768fd] succeeded in 1.2666408899995076s: None 2024-02-23T00:38:02.575313632Z [2024-02-23 00:38:02,574: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[646e638f-d30b-4faf-9fd5-d2c2d4a49d3a] succeeded in 1.6895119829996474s: None 2024-02-23T00:38:02.740934016Z [2024-02-23 00:38:02,740: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:38:02.744531677Z [2024-02-23 00:38:02,743: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:38:02.769708079Z [2024-02-23 00:38:02,769: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:38:02.771128843Z [2024-02-23 00:38:02,770: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:38:02.771185002Z [2024-02-23 00:38:02,771: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:38:02.771355719Z [2024-02-23 00:38:02,771: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:38:02.771399135Z [2024-02-23 00:38:02,771: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:38:02.771695739Z [2024-02-23 00:38:02,771: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:38:02.771773073Z [2024-02-23 00:38:02,771: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:38:02.891767384Z [2024-02-23 00:38:02,891: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:38:02.948741467Z [2024-02-23 00:38:02,948: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:38:02.952468442Z [2024-02-23 00:38:02,951: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:38:02.978858749Z [2024-02-23 00:38:02,978: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:38:02.981013608Z [2024-02-23 00:38:02,980: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:38:02.981028916Z [2024-02-23 00:38:02,980: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:38:02.981142493Z [2024-02-23 00:38:02,980: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:38:02.981152919Z [2024-02-23 00:38:02,981: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:38:02.981415785Z [2024-02-23 00:38:02,981: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:38:02.981425680Z [2024-02-23 00:38:02,981: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:38:03.096738923Z [2024-02-23 00:38:03,096: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:38:04.941752406Z [2024-02-23 00:38:04,941: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1fff0a41-9e30-400e-802e-863b510eee44] succeeded in 4.071760970000469s: None 2024-02-23T00:38:05.452846390Z [2024-02-23 00:38:05,452: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[40c6f503-5755-4249-a9ed-9e73e0c33bf3] succeeded in 4.575999669000339s: None 2024-02-23T00:39:00.876755125Z [2024-02-23 00:39:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e3f92f6-5672-432b-866e-2eea722d6952] received 2024-02-23T00:39:00.885955426Z [2024-02-23 00:39:00,885: INFO/ForkPoolWorker-15] [5e3f92f6-5672-432b-866e-2eea722d6952] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:39:00.888941193Z [2024-02-23 00:39:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd1d3bd5-1900-4cf6-b6c3-38d1b3f389a1] received 2024-02-23T00:39:00.894477647Z [2024-02-23 00:39:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79f41350-41a4-403a-82b6-66df4a53e030] received 2024-02-23T00:39:00.902068699Z [2024-02-23 00:39:00,901: INFO/ForkPoolWorker-1] [79f41350-41a4-403a-82b6-66df4a53e030] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:39:00.902872857Z [2024-02-23 00:39:00,902: INFO/ForkPoolWorker-16] [dd1d3bd5-1900-4cf6-b6c3-38d1b3f389a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:39:01.237801377Z [2024-02-23 00:39:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:39:01.241052140Z [2024-02-23 00:39:01,237: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:39:01.277487329Z [2024-02-23 00:39:01,274: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:39:01.435737206Z [2024-02-23 00:39:01,435: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:39:01.439944683Z [2024-02-23 00:39:01,439: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:39:01.480461229Z [2024-02-23 00:39:01,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:39:01.488364400Z [2024-02-23 00:39:01,487: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:39:01.489020951Z [2024-02-23 00:39:01,488: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:39:01.489452553Z [2024-02-23 00:39:01,489: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:39:01.490108711Z [2024-02-23 00:39:01,489: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:39:01.641519715Z [2024-02-23 00:39:01,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:39:02.341510166Z [2024-02-23 00:39:02,341: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e3f92f6-5672-432b-866e-2eea722d6952] succeeded in 1.462709339999492s: None 2024-02-23T00:39:02.472311441Z [2024-02-23 00:39:02,471: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:39:02.474251776Z [2024-02-23 00:39:02,473: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:39:02.475981377Z [2024-02-23 00:39:02,475: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:39:02.477636917Z [2024-02-23 00:39:02,477: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:39:02.494201414Z [2024-02-23 00:39:02,493: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:39:02.496053948Z [2024-02-23 00:39:02,495: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:39:02.496142715Z [2024-02-23 00:39:02,495: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:39:02.496359353Z [2024-02-23 00:39:02,496: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:39:02.496421925Z [2024-02-23 00:39:02,496: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:39:02.496838868Z [2024-02-23 00:39:02,496: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:39:02.496863611Z [2024-02-23 00:39:02,496: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:39:02.513364282Z [2024-02-23 00:39:02,513: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:39:02.519573634Z [2024-02-23 00:39:02,519: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:39:02.521194970Z [2024-02-23 00:39:02,520: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:39:02.521356891Z [2024-02-23 00:39:02,521: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:39:02.521376382Z [2024-02-23 00:39:02,521: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:39:02.521650693Z [2024-02-23 00:39:02,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:39:02.521661061Z [2024-02-23 00:39:02,521: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:39:02.595702725Z [2024-02-23 00:39:02,595: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:39:02.619011842Z [2024-02-23 00:39:02,618: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:39:04.268479977Z [2024-02-23 00:39:04,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd1d3bd5-1900-4cf6-b6c3-38d1b3f389a1] succeeded in 3.377410068000245s: None 2024-02-23T00:39:05.445248134Z [2024-02-23 00:39:05,444: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79f41350-41a4-403a-82b6-66df4a53e030] succeeded in 4.548959995999212s: None 2024-02-23T00:40:00.456121670Z [2024-02-23 00:40:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64baf2c6-4279-4063-8412-1a4ed0974a2c] received 2024-02-23T00:40:00.457672982Z [2024-02-23 00:40:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4f2c98f-9146-4e38-b42e-15e5b439cf31] received 2024-02-23T00:40:00.459150331Z [2024-02-23 00:40:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[362fc898-88ef-49c5-a6e8-8c60f2c85b11] received 2024-02-23T00:40:00.460559253Z [2024-02-23 00:40:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[521a7312-9c46-4c89-90f3-0c0e332dc49d] received 2024-02-23T00:40:00.468400060Z [2024-02-23 00:40:00,468: INFO/ForkPoolWorker-15] [64baf2c6-4279-4063-8412-1a4ed0974a2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:40:00.474432958Z [2024-02-23 00:40:00,474: INFO/ForkPoolWorker-16] [d4f2c98f-9146-4e38-b42e-15e5b439cf31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:40:00.475265082Z [2024-02-23 00:40:00,475: INFO/ForkPoolWorker-2] [521a7312-9c46-4c89-90f3-0c0e332dc49d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:40:00.476036852Z [2024-02-23 00:40:00,475: INFO/ForkPoolWorker-1] [362fc898-88ef-49c5-a6e8-8c60f2c85b11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:40:00.502667863Z [2024-02-23 00:40:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b76019fc-45a3-4d6f-8917-b2e4477f5d1f] received 2024-02-23T00:40:00.528486122Z [2024-02-23 00:40:00,528: INFO/ForkPoolWorker-3] [b76019fc-45a3-4d6f-8917-b2e4477f5d1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:40:00.878385803Z [2024-02-23 00:40:00,873: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:40:00.946041187Z [2024-02-23 00:40:00,938: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:40:01.063890247Z [2024-02-23 00:40:01,060: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:40:01.180429660Z [2024-02-23 00:40:01,177: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:40:01.213657937Z [2024-02-23 00:40:01,213: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:01.301589485Z [2024-02-23 00:40:01,294: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:40:01.338925302Z [2024-02-23 00:40:01,338: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:40:01.342606416Z [2024-02-23 00:40:01,342: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:01.406432476Z [2024-02-23 00:40:01,406: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:40:01.411832677Z [2024-02-23 00:40:01,411: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:40:01.411909472Z [2024-02-23 00:40:01,411: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:40:01.411914801Z [2024-02-23 00:40:01,411: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:40:01.412066301Z [2024-02-23 00:40:01,411: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:40:01.541396630Z [2024-02-23 00:40:01,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:01.880207015Z [2024-02-23 00:40:01,879: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[521a7312-9c46-4c89-90f3-0c0e332dc49d] succeeded in 1.4162976419993356s: None 2024-02-23T00:40:02.368313746Z [2024-02-23 00:40:02,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64baf2c6-4279-4063-8412-1a4ed0974a2c] succeeded in 1.9083971149993886s: None 2024-02-23T00:40:02.412574712Z [2024-02-23 00:40:02,412: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:40:02.416013852Z [2024-02-23 00:40:02,415: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:02.450539411Z [2024-02-23 00:40:02,450: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:40:02.455313012Z [2024-02-23 00:40:02,454: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:40:02.455605435Z [2024-02-23 00:40:02,455: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:40:02.455876238Z [2024-02-23 00:40:02,455: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:40:02.456201856Z [2024-02-23 00:40:02,455: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:40:02.456734073Z [2024-02-23 00:40:02,456: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:40:02.457094093Z [2024-02-23 00:40:02,456: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:40:02.565894238Z [2024-02-23 00:40:02,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:02.753422845Z [2024-02-23 00:40:02,752: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:40:02.757190276Z [2024-02-23 00:40:02,756: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:02.776967065Z [2024-02-23 00:40:02,776: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:40:02.778317444Z [2024-02-23 00:40:02,778: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:40:02.778392667Z [2024-02-23 00:40:02,778: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:40:02.778563915Z [2024-02-23 00:40:02,778: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:40:02.778648356Z [2024-02-23 00:40:02,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:40:02.778937449Z [2024-02-23 00:40:02,778: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:40:02.779031586Z [2024-02-23 00:40:02,778: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:40:02.822686189Z [2024-02-23 00:40:02,822: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T00:40:02.826314618Z [2024-02-23 00:40:02,825: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:02.860444612Z [2024-02-23 00:40:02,860: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:40:02.861797371Z [2024-02-23 00:40:02,861: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:40:02.861813447Z [2024-02-23 00:40:02,861: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:40:02.861932707Z [2024-02-23 00:40:02,861: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:40:02.861943929Z [2024-02-23 00:40:02,861: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T00:40:02.862158962Z [2024-02-23 00:40:02,862: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:40:02.862171081Z [2024-02-23 00:40:02,862: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:40:02.873672797Z [2024-02-23 00:40:02,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:03.024125959Z [2024-02-23 00:40:03,023: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:03.340439581Z [2024-02-23 00:40:03,339: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[362fc898-88ef-49c5-a6e8-8c60f2c85b11] succeeded in 2.878787060999457s: None 2024-02-23T00:40:04.170744551Z [2024-02-23 00:40:04,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b85a35e4-9437-4ce1-b14c-b998f81669af] received 2024-02-23T00:40:04.184685992Z [2024-02-23 00:40:04,184: INFO/ForkPoolWorker-15] [b85a35e4-9437-4ce1-b14c-b998f81669af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:40:04.488248282Z [2024-02-23 00:40:04,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:40:04.604418406Z [2024-02-23 00:40:04,604: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4f2c98f-9146-4e38-b42e-15e5b439cf31] succeeded in 4.141122498999721s: None 2024-02-23T00:40:05.147801093Z [2024-02-23 00:40:05,147: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b76019fc-45a3-4d6f-8917-b2e4477f5d1f] succeeded in 4.641437946999758s: None 2024-02-23T00:40:05.822619441Z [2024-02-23 00:40:05,822: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:40:05.826136910Z [2024-02-23 00:40:05,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:05.853231872Z [2024-02-23 00:40:05,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:40:05.855211730Z [2024-02-23 00:40:05,854: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:40:05.855243611Z [2024-02-23 00:40:05,855: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:40:05.855361167Z [2024-02-23 00:40:05,855: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:40:05.855446501Z [2024-02-23 00:40:05,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:40:05.855946145Z [2024-02-23 00:40:05,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:40:05.855962513Z [2024-02-23 00:40:05,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:40:05.966308985Z [2024-02-23 00:40:05,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:06.698504822Z [2024-02-23 00:40:06,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f9675e1-ad63-4470-a696-653bf0812188] received 2024-02-23T00:40:06.712457034Z [2024-02-23 00:40:06,712: INFO/ForkPoolWorker-16] [4f9675e1-ad63-4470-a696-653bf0812188] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:40:06.742133116Z [2024-02-23 00:40:06,741: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b85a35e4-9437-4ce1-b14c-b998f81669af] succeeded in 2.5690696609999577s: None 2024-02-23T00:40:07.046098077Z [2024-02-23 00:40:07,042: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:40:08.286513458Z [2024-02-23 00:40:08,286: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:40:08.290091592Z [2024-02-23 00:40:08,289: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:08.312433741Z [2024-02-23 00:40:08,312: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:40:08.313908452Z [2024-02-23 00:40:08,313: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:40:08.313979731Z [2024-02-23 00:40:08,313: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:40:08.314151580Z [2024-02-23 00:40:08,313: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:40:08.314175690Z [2024-02-23 00:40:08,313: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:40:08.315390944Z [2024-02-23 00:40:08,315: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:40:08.315426449Z [2024-02-23 00:40:08,315: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:40:08.402487873Z [2024-02-23 00:40:08,402: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:09.004398613Z [2024-02-23 00:40:09,003: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f9675e1-ad63-4470-a696-653bf0812188] succeeded in 2.305702227999973s: None 2024-02-23T00:40:09.673276609Z [2024-02-23 00:40:09,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2b49a92-b677-4c57-92b0-bc7906d1eafa] received 2024-02-23T00:40:09.681791425Z [2024-02-23 00:40:09,681: INFO/ForkPoolWorker-15] [b2b49a92-b677-4c57-92b0-bc7906d1eafa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:40:09.971838655Z [2024-02-23 00:40:09,967: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:40:11.065958492Z [2024-02-23 00:40:11,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:40:11.069422925Z [2024-02-23 00:40:11,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:40:11.094534956Z [2024-02-23 00:40:11,094: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:40:11.096894873Z [2024-02-23 00:40:11,096: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:40:11.096976056Z [2024-02-23 00:40:11,096: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:40:11.097229110Z [2024-02-23 00:40:11,097: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:40:11.097318063Z [2024-02-23 00:40:11,097: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:40:11.097640356Z [2024-02-23 00:40:11,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:40:11.097803995Z [2024-02-23 00:40:11,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:40:11.186182092Z [2024-02-23 00:40:11,185: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:40:11.770816574Z [2024-02-23 00:40:11,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2b49a92-b677-4c57-92b0-bc7906d1eafa] succeeded in 2.095251002999248s: None 2024-02-23T00:41:00.587412336Z [2024-02-23 00:41:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5afda00f-e026-44c1-b3e9-8735213395af] received 2024-02-23T00:41:00.601627181Z [2024-02-23 00:41:00,601: INFO/ForkPoolWorker-15] [5afda00f-e026-44c1-b3e9-8735213395af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:41:00.602818729Z [2024-02-23 00:41:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d54f1f7f-f553-410c-b19a-5f649be1b06a] received 2024-02-23T00:41:00.613563562Z [2024-02-23 00:41:00,613: INFO/ForkPoolWorker-16] [d54f1f7f-f553-410c-b19a-5f649be1b06a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:41:00.623845840Z [2024-02-23 00:41:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5539a47b-08f9-40c2-8a93-d7b76fe0e3cf] received 2024-02-23T00:41:00.634588469Z [2024-02-23 00:41:00,634: INFO/ForkPoolWorker-1] [5539a47b-08f9-40c2-8a93-d7b76fe0e3cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:41:01.046952284Z [2024-02-23 00:41:01,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:41:01.102469946Z [2024-02-23 00:41:01,098: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:41:01.249354928Z [2024-02-23 00:41:01,248: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:41:01.253298002Z [2024-02-23 00:41:01,252: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:41:01.263770165Z [2024-02-23 00:41:01,260: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:41:01.307377870Z [2024-02-23 00:41:01,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:41:01.316800213Z [2024-02-23 00:41:01,316: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:41:01.316925075Z [2024-02-23 00:41:01,316: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:41:01.317032055Z [2024-02-23 00:41:01,316: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:41:01.320587174Z [2024-02-23 00:41:01,320: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:41:01.472165496Z [2024-02-23 00:41:01,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:41:02.299337026Z [2024-02-23 00:41:02,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5afda00f-e026-44c1-b3e9-8735213395af] succeeded in 1.7069093440004508s: None 2024-02-23T00:41:02.829218844Z [2024-02-23 00:41:02,828: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:41:02.832871007Z [2024-02-23 00:41:02,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:41:02.852622356Z [2024-02-23 00:41:02,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:41:02.853961411Z [2024-02-23 00:41:02,853: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:41:02.854257539Z [2024-02-23 00:41:02,853: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:41:02.854530745Z [2024-02-23 00:41:02,854: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:41:02.854656838Z [2024-02-23 00:41:02,854: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:41:02.855312380Z [2024-02-23 00:41:02,854: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:41:02.855529613Z [2024-02-23 00:41:02,855: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:41:02.900237635Z [2024-02-23 00:41:02,899: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:41:02.904986500Z [2024-02-23 00:41:02,904: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:41:02.939688034Z [2024-02-23 00:41:02,939: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:41:02.943312132Z [2024-02-23 00:41:02,943: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:41:02.947642994Z [2024-02-23 00:41:02,947: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:41:02.947751752Z [2024-02-23 00:41:02,947: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:41:02.947876290Z [2024-02-23 00:41:02,947: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:41:02.947887029Z [2024-02-23 00:41:02,947: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:41:02.948178232Z [2024-02-23 00:41:02,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:41:02.948230510Z [2024-02-23 00:41:02,948: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:41:03.084531180Z [2024-02-23 00:41:03,084: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:41:05.307301288Z [2024-02-23 00:41:05,306: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d54f1f7f-f553-410c-b19a-5f649be1b06a] succeeded in 4.702571497000463s: None 2024-02-23T00:41:05.558490211Z [2024-02-23 00:41:05,557: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5539a47b-08f9-40c2-8a93-d7b76fe0e3cf] succeeded in 4.9326072140002s: None 2024-02-23T00:42:00.605851871Z [2024-02-23 00:42:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f64a7cc0-9977-4b67-8c91-e1f59a766149] received 2024-02-23T00:42:00.609693775Z [2024-02-23 00:42:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[741b7826-a380-4846-bd5d-85f5c4e58c1a] received 2024-02-23T00:42:00.619665968Z [2024-02-23 00:42:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49fa4951-002f-449a-97fe-dde250f1f828] received 2024-02-23T00:42:00.621881182Z [2024-02-23 00:42:00,621: INFO/ForkPoolWorker-15] [f64a7cc0-9977-4b67-8c91-e1f59a766149] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:42:00.630287714Z [2024-02-23 00:42:00,630: INFO/ForkPoolWorker-16] [741b7826-a380-4846-bd5d-85f5c4e58c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:42:00.634520988Z [2024-02-23 00:42:00,634: INFO/ForkPoolWorker-1] [49fa4951-002f-449a-97fe-dde250f1f828] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:42:00.635268302Z [2024-02-23 00:42:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89677299-0cfc-4014-83da-b35a68b917e0] received 2024-02-23T00:42:00.658383854Z [2024-02-23 00:42:00,658: INFO/ForkPoolWorker-2] [89677299-0cfc-4014-83da-b35a68b917e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:42:00.944468907Z [2024-02-23 00:42:00,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:42:00.982931748Z [2024-02-23 00:42:00,979: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:42:01.063025624Z [2024-02-23 00:42:01,059: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:42:01.150216961Z [2024-02-23 00:42:01,149: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:42:01.155619211Z [2024-02-23 00:42:01,155: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:42:01.159035208Z [2024-02-23 00:42:01,155: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:42:01.183058810Z [2024-02-23 00:42:01,182: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:42:01.184156657Z [2024-02-23 00:42:01,183: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:42:01.184308293Z [2024-02-23 00:42:01,184: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:42:01.184400013Z [2024-02-23 00:42:01,184: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:42:01.184646935Z [2024-02-23 00:42:01,184: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:42:01.262451215Z [2024-02-23 00:42:01,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:42:01.305357746Z [2024-02-23 00:42:01,305: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:42:01.858510897Z [2024-02-23 00:42:01,858: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f64a7cc0-9977-4b67-8c91-e1f59a766149] succeeded in 1.247498858999279s: None 2024-02-23T00:42:02.030970599Z [2024-02-23 00:42:02,030: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[89677299-0cfc-4014-83da-b35a68b917e0] succeeded in 1.390965356000379s: None 2024-02-23T00:42:02.438012151Z [2024-02-23 00:42:02,437: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:42:02.441551062Z [2024-02-23 00:42:02,441: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:42:02.463442574Z [2024-02-23 00:42:02,463: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:42:02.465375205Z [2024-02-23 00:42:02,465: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:42:02.465773906Z [2024-02-23 00:42:02,465: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:42:02.465898123Z [2024-02-23 00:42:02,465: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:42:02.466024527Z [2024-02-23 00:42:02,465: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:42:02.466435853Z [2024-02-23 00:42:02,466: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:42:02.466562162Z [2024-02-23 00:42:02,466: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:42:02.549588736Z [2024-02-23 00:42:02,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:42:02.634685165Z [2024-02-23 00:42:02,634: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:42:02.638269795Z [2024-02-23 00:42:02,637: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:42:02.668372635Z [2024-02-23 00:42:02,668: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:42:02.670388344Z [2024-02-23 00:42:02,670: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:42:02.670406341Z [2024-02-23 00:42:02,670: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:42:02.670765667Z [2024-02-23 00:42:02,670: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:42:02.670981923Z [2024-02-23 00:42:02,670: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:42:02.671528761Z [2024-02-23 00:42:02,671: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:42:02.671538813Z [2024-02-23 00:42:02,671: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:42:02.775521146Z [2024-02-23 00:42:02,775: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:42:04.415799336Z [2024-02-23 00:42:04,415: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49fa4951-002f-449a-97fe-dde250f1f828] succeeded in 3.792382018999888s: None 2024-02-23T00:42:04.572530033Z [2024-02-23 00:42:04,572: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[741b7826-a380-4846-bd5d-85f5c4e58c1a] succeeded in 3.9605137159996957s: None 2024-02-23T00:43:00.457815446Z [2024-02-23 00:43:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[196059e6-6f09-4e35-9539-fa4f403ee8a5] received 2024-02-23T00:43:00.464863812Z [2024-02-23 00:43:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70c59628-6252-44c9-86cc-e0fb24c81dc3] received 2024-02-23T00:43:00.468529175Z [2024-02-23 00:43:00,468: INFO/ForkPoolWorker-15] [196059e6-6f09-4e35-9539-fa4f403ee8a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:43:00.474291600Z [2024-02-23 00:43:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[706867a6-f852-4b57-a1ec-b15d8368bce4] received 2024-02-23T00:43:00.479357477Z [2024-02-23 00:43:00,477: INFO/ForkPoolWorker-16] [70c59628-6252-44c9-86cc-e0fb24c81dc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:43:00.485390248Z [2024-02-23 00:43:00,485: INFO/ForkPoolWorker-1] [706867a6-f852-4b57-a1ec-b15d8368bce4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:43:00.770590011Z [2024-02-23 00:43:00,767: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:43:00.778354740Z [2024-02-23 00:43:00,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:43:00.781399920Z [2024-02-23 00:43:00,778: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:43:00.934239120Z [2024-02-23 00:43:00,933: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:43:00.938454687Z [2024-02-23 00:43:00,937: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:43:00.959709717Z [2024-02-23 00:43:00,959: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:43:00.961219108Z [2024-02-23 00:43:00,961: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:43:00.961346522Z [2024-02-23 00:43:00,961: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:43:00.961417143Z [2024-02-23 00:43:00,961: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:43:00.962013951Z [2024-02-23 00:43:00,961: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:43:01.066033800Z [2024-02-23 00:43:01,065: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:43:01.681590318Z [2024-02-23 00:43:01,681: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70c59628-6252-44c9-86cc-e0fb24c81dc3] succeeded in 1.2134733339999002s: None 2024-02-23T00:43:01.934158951Z [2024-02-23 00:43:01,933: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:43:01.937888047Z [2024-02-23 00:43:01,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:43:01.958941226Z [2024-02-23 00:43:01,958: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:43:01.960399721Z [2024-02-23 00:43:01,960: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:43:01.960892099Z [2024-02-23 00:43:01,960: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:43:01.961087256Z [2024-02-23 00:43:01,960: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:43:01.961218702Z [2024-02-23 00:43:01,961: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:43:01.961641352Z [2024-02-23 00:43:01,961: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:43:01.961958231Z [2024-02-23 00:43:01,961: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:43:01.972871702Z [2024-02-23 00:43:01,972: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:43:01.976236350Z [2024-02-23 00:43:01,975: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:43:02.009647626Z [2024-02-23 00:43:02,009: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:43:02.011991876Z [2024-02-23 00:43:02,011: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:43:02.012527517Z [2024-02-23 00:43:02,012: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:43:02.012832902Z [2024-02-23 00:43:02,012: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:43:02.013020525Z [2024-02-23 00:43:02,012: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:43:02.013467166Z [2024-02-23 00:43:02,013: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:43:02.014217760Z [2024-02-23 00:43:02,013: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:43:02.053907093Z [2024-02-23 00:43:02,053: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:43:02.095096422Z [2024-02-23 00:43:02,094: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:43:03.704241218Z [2024-02-23 00:43:03,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[706867a6-f852-4b57-a1ec-b15d8368bce4] succeeded in 3.228008289999707s: None 2024-02-23T00:43:03.834206182Z [2024-02-23 00:43:03,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[196059e6-6f09-4e35-9539-fa4f403ee8a5] succeeded in 3.372638349999761s: None 2024-02-23T00:44:00.881600912Z [2024-02-23 00:44:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e454c869-2385-4c3c-89ee-9330d48aedf3] received 2024-02-23T00:44:00.884543781Z [2024-02-23 00:44:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[987bf88c-fa78-4fc0-a62c-35be82a878a2] received 2024-02-23T00:44:00.893385497Z [2024-02-23 00:44:00,893: INFO/ForkPoolWorker-16] [987bf88c-fa78-4fc0-a62c-35be82a878a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:44:00.894910227Z [2024-02-23 00:44:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66105ef3-4ae9-4972-bca0-9b7dae0ab6f1] received 2024-02-23T00:44:00.897052017Z [2024-02-23 00:44:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d1c27f7-7e5d-4c08-9aea-fb3ef8c8850a] received 2024-02-23T00:44:00.905645482Z [2024-02-23 00:44:00,905: INFO/ForkPoolWorker-2] [8d1c27f7-7e5d-4c08-9aea-fb3ef8c8850a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:44:00.908880834Z [2024-02-23 00:44:00,908: INFO/ForkPoolWorker-1] [66105ef3-4ae9-4972-bca0-9b7dae0ab6f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:44:00.918545583Z [2024-02-23 00:44:00,918: INFO/ForkPoolWorker-15] [e454c869-2385-4c3c-89ee-9330d48aedf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:44:01.228352108Z [2024-02-23 00:44:01,225: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:44:01.246285172Z [2024-02-23 00:44:01,243: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:44:01.299592999Z [2024-02-23 00:44:01,292: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:44:01.308042886Z [2024-02-23 00:44:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:44:01.605744991Z [2024-02-23 00:44:01,605: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:44:01.614943532Z [2024-02-23 00:44:01,612: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:44:01.627947617Z [2024-02-23 00:44:01,627: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:44:01.649909522Z [2024-02-23 00:44:01,649: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:44:01.654612283Z [2024-02-23 00:44:01,654: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:44:01.655047013Z [2024-02-23 00:44:01,654: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:44:01.655279076Z [2024-02-23 00:44:01,655: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:44:01.655739471Z [2024-02-23 00:44:01,655: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:44:01.830450569Z [2024-02-23 00:44:01,830: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:44:02.313310746Z [2024-02-23 00:44:02,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e454c869-2385-4c3c-89ee-9330d48aedf3] succeeded in 1.4254840550001973s: None 2024-02-23T00:44:02.614490728Z [2024-02-23 00:44:02,614: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66105ef3-4ae9-4972-bca0-9b7dae0ab6f1] succeeded in 1.717982672999824s: None 2024-02-23T00:44:02.616736733Z [2024-02-23 00:44:02,616: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:44:02.620515598Z [2024-02-23 00:44:02,620: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:44:02.640513697Z [2024-02-23 00:44:02,640: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:44:02.641900969Z [2024-02-23 00:44:02,641: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:44:02.641962799Z [2024-02-23 00:44:02,641: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:44:02.642182636Z [2024-02-23 00:44:02,641: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:44:02.642202557Z [2024-02-23 00:44:02,642: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:44:02.642527186Z [2024-02-23 00:44:02,642: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:44:02.642547441Z [2024-02-23 00:44:02,642: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:44:02.708921914Z [2024-02-23 00:44:02,708: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:44:02.712508819Z [2024-02-23 00:44:02,711: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:44:02.743543470Z [2024-02-23 00:44:02,743: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:44:02.750933241Z [2024-02-23 00:44:02,750: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:44:02.750988484Z [2024-02-23 00:44:02,750: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:44:02.751223961Z [2024-02-23 00:44:02,750: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:44:02.751317138Z [2024-02-23 00:44:02,751: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:44:02.751814225Z [2024-02-23 00:44:02,751: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:44:02.751920523Z [2024-02-23 00:44:02,751: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:44:02.756539933Z [2024-02-23 00:44:02,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:44:02.864015985Z [2024-02-23 00:44:02,863: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:44:04.654465059Z [2024-02-23 00:44:04,653: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[987bf88c-fa78-4fc0-a62c-35be82a878a2] succeeded in 3.767213394999999s: None 2024-02-23T00:44:04.868573815Z [2024-02-23 00:44:04,868: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8d1c27f7-7e5d-4c08-9aea-fb3ef8c8850a] succeeded in 3.969702633000452s: None 2024-02-23T00:45:00.855512109Z [2024-02-23 00:45:00,855: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98323ead-b8ee-48a2-8559-b30c151590a6] received 2024-02-23T00:45:00.860301409Z [2024-02-23 00:45:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31a2faed-a118-4b54-a88c-907b9de07fa1] received 2024-02-23T00:45:00.862464718Z [2024-02-23 00:45:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a560415-2419-4749-b9f6-d703fd739e2a] received 2024-02-23T00:45:00.864198532Z [2024-02-23 00:45:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c525a0c-a6fe-4b2d-8561-49dcefc5f491] received 2024-02-23T00:45:00.867196318Z [2024-02-23 00:45:00,866: INFO/ForkPoolWorker-15] [98323ead-b8ee-48a2-8559-b30c151590a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:45:00.873164762Z [2024-02-23 00:45:00,872: INFO/ForkPoolWorker-1] [6a560415-2419-4749-b9f6-d703fd739e2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:45:00.874272164Z [2024-02-23 00:45:00,873: INFO/ForkPoolWorker-16] [31a2faed-a118-4b54-a88c-907b9de07fa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:45:00.878686916Z [2024-02-23 00:45:00,876: INFO/ForkPoolWorker-2] [1c525a0c-a6fe-4b2d-8561-49dcefc5f491] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:45:01.170494401Z [2024-02-23 00:45:01,166: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:45:01.306658894Z [2024-02-23 00:45:01,302: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:45:01.320080883Z [2024-02-23 00:45:01,317: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:45:01.376244956Z [2024-02-23 00:45:01,373: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:45:01.498183802Z [2024-02-23 00:45:01,497: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T00:45:01.504531818Z [2024-02-23 00:45:01,504: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:01.554380368Z [2024-02-23 00:45:01,554: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:45:01.560728256Z [2024-02-23 00:45:01,560: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:45:01.560903297Z [2024-02-23 00:45:01,560: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:45:01.561045227Z [2024-02-23 00:45:01,560: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T00:45:01.561336923Z [2024-02-23 00:45:01,561: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:45:01.710847862Z [2024-02-23 00:45:01,710: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:02.355912221Z [2024-02-23 00:45:02,355: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c525a0c-a6fe-4b2d-8561-49dcefc5f491] succeeded in 1.4895972360000087s: None 2024-02-23T00:45:02.525812980Z [2024-02-23 00:45:02,525: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:45:02.529431440Z [2024-02-23 00:45:02,528: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:02.553269276Z [2024-02-23 00:45:02,553: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:45:02.555104738Z [2024-02-23 00:45:02,554: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:45:02.555139460Z [2024-02-23 00:45:02,555: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:45:02.555234968Z [2024-02-23 00:45:02,555: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:45:02.555269639Z [2024-02-23 00:45:02,555: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:45:02.555475629Z [2024-02-23 00:45:02,555: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:45:02.555520337Z [2024-02-23 00:45:02,555: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:45:02.650705507Z [2024-02-23 00:45:02,650: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:02.757805632Z [2024-02-23 00:45:02,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:45:02.761419909Z [2024-02-23 00:45:02,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:02.772342472Z [2024-02-23 00:45:02,771: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:45:02.776104397Z [2024-02-23 00:45:02,775: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:02.779972940Z [2024-02-23 00:45:02,779: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:45:02.781289576Z [2024-02-23 00:45:02,781: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:45:02.781444846Z [2024-02-23 00:45:02,781: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:45:02.781654487Z [2024-02-23 00:45:02,781: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:45:02.781679078Z [2024-02-23 00:45:02,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:45:02.781966218Z [2024-02-23 00:45:02,781: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:45:02.782036386Z [2024-02-23 00:45:02,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:45:02.797491097Z [2024-02-23 00:45:02,797: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:45:02.799094013Z [2024-02-23 00:45:02,798: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:45:02.799356426Z [2024-02-23 00:45:02,799: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:45:02.799619211Z [2024-02-23 00:45:02,799: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:45:02.799781004Z [2024-02-23 00:45:02,799: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:45:02.800177667Z [2024-02-23 00:45:02,799: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:45:02.800299568Z [2024-02-23 00:45:02,800: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:45:02.866167708Z [2024-02-23 00:45:02,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:02.874581198Z [2024-02-23 00:45:02,874: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:03.539883860Z [2024-02-23 00:45:03,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98323ead-b8ee-48a2-8559-b30c151590a6] succeeded in 2.682096749000266s: None 2024-02-23T00:45:03.758817250Z [2024-02-23 00:45:03,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8edb59a4-9839-4ecf-8f6c-c96e758714c0] received 2024-02-23T00:45:03.766926454Z [2024-02-23 00:45:03,766: INFO/ForkPoolWorker-15] [8edb59a4-9839-4ecf-8f6c-c96e758714c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:45:04.070689851Z [2024-02-23 00:45:04,067: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:45:04.320652984Z [2024-02-23 00:45:04,320: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31a2faed-a118-4b54-a88c-907b9de07fa1] succeeded in 3.4562008969996896s: None 2024-02-23T00:45:04.919056403Z [2024-02-23 00:45:04,914: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a560415-2419-4749-b9f6-d703fd739e2a] succeeded in 4.049930644000597s: None 2024-02-23T00:45:05.411544622Z [2024-02-23 00:45:05,411: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:45:05.415009077Z [2024-02-23 00:45:05,414: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:05.432745400Z [2024-02-23 00:45:05,432: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:45:05.434079848Z [2024-02-23 00:45:05,433: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:45:05.434096142Z [2024-02-23 00:45:05,433: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:45:05.434292505Z [2024-02-23 00:45:05,434: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:45:05.434361207Z [2024-02-23 00:45:05,434: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:45:05.434660394Z [2024-02-23 00:45:05,434: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:45:05.434686980Z [2024-02-23 00:45:05,434: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:45:05.531004798Z [2024-02-23 00:45:05,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:06.138466457Z [2024-02-23 00:45:06,138: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8edb59a4-9839-4ecf-8f6c-c96e758714c0] succeeded in 2.3770610350002244s: None 2024-02-23T00:45:06.417585149Z [2024-02-23 00:45:06,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7f150b3-fa9a-45b6-b9c0-8a2cdcf4901f] received 2024-02-23T00:45:06.425981067Z [2024-02-23 00:45:06,425: INFO/ForkPoolWorker-15] [f7f150b3-fa9a-45b6-b9c0-8a2cdcf4901f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:45:06.720818848Z [2024-02-23 00:45:06,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:45:07.845820446Z [2024-02-23 00:45:07,845: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:45:07.849287072Z [2024-02-23 00:45:07,848: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:07.895046920Z [2024-02-23 00:45:07,884: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:45:07.895079092Z [2024-02-23 00:45:07,885: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:45:07.895084045Z [2024-02-23 00:45:07,885: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:45:07.895088474Z [2024-02-23 00:45:07,886: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:45:07.895092815Z [2024-02-23 00:45:07,886: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:45:07.895096044Z [2024-02-23 00:45:07,886: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:45:07.895099614Z [2024-02-23 00:45:07,886: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:45:08.008367706Z [2024-02-23 00:45:08,008: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:08.605420499Z [2024-02-23 00:45:08,605: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7f150b3-fa9a-45b6-b9c0-8a2cdcf4901f] succeeded in 2.183370255999762s: None 2024-02-23T00:45:08.755822570Z [2024-02-23 00:45:08,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[423d2b18-0f18-4f8a-b560-d1aa5b8de2c1] received 2024-02-23T00:45:08.764409182Z [2024-02-23 00:45:08,764: INFO/ForkPoolWorker-15] [423d2b18-0f18-4f8a-b560-d1aa5b8de2c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:45:09.058530878Z [2024-02-23 00:45:09,055: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:45:10.170078567Z [2024-02-23 00:45:10,169: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:45:10.173546154Z [2024-02-23 00:45:10,173: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:45:10.193329008Z [2024-02-23 00:45:10,193: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:45:10.195304803Z [2024-02-23 00:45:10,195: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:45:10.195749582Z [2024-02-23 00:45:10,195: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:45:10.196084385Z [2024-02-23 00:45:10,195: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:45:10.196315548Z [2024-02-23 00:45:10,196: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:45:10.196682907Z [2024-02-23 00:45:10,196: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:45:10.196775427Z [2024-02-23 00:45:10,196: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:45:10.286070250Z [2024-02-23 00:45:10,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:45:10.845539950Z [2024-02-23 00:45:10,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[423d2b18-0f18-4f8a-b560-d1aa5b8de2c1] succeeded in 2.0874551300003077s: None 2024-02-23T00:46:00.615731464Z [2024-02-23 00:46:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e98c55e3-f35d-4172-9e0a-c87a9c011aaf] received 2024-02-23T00:46:00.618270229Z [2024-02-23 00:46:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c46b2dc8-3a32-46bd-8c01-5d263e48c600] received 2024-02-23T00:46:00.624489217Z [2024-02-23 00:46:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5833a6ef-e163-44b9-92c6-1314bedb23ba] received 2024-02-23T00:46:00.626746456Z [2024-02-23 00:46:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[898cb971-0e1c-48e2-93a0-49363746544d] received 2024-02-23T00:46:00.630989620Z [2024-02-23 00:46:00,630: INFO/ForkPoolWorker-16] [c46b2dc8-3a32-46bd-8c01-5d263e48c600] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:46:00.631585492Z [2024-02-23 00:46:00,631: INFO/ForkPoolWorker-1] [5833a6ef-e163-44b9-92c6-1314bedb23ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:46:00.632145324Z [2024-02-23 00:46:00,631: INFO/ForkPoolWorker-15] [e98c55e3-f35d-4172-9e0a-c87a9c011aaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:46:00.645631401Z [2024-02-23 00:46:00,645: INFO/ForkPoolWorker-2] [898cb971-0e1c-48e2-93a0-49363746544d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:46:00.938578026Z [2024-02-23 00:46:00,935: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:46:00.957371171Z [2024-02-23 00:46:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:46:00.993600227Z [2024-02-23 00:46:00,990: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:46:01.068275910Z [2024-02-23 00:46:01,065: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:46:01.172332883Z [2024-02-23 00:46:01,171: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:46:01.179212705Z [2024-02-23 00:46:01,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:46:01.224014543Z [2024-02-23 00:46:01,223: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:46:01.226106947Z [2024-02-23 00:46:01,225: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:46:01.228918529Z [2024-02-23 00:46:01,228: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:46:01.229302635Z [2024-02-23 00:46:01,228: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:46:01.230919647Z [2024-02-23 00:46:01,230: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:46:01.315455768Z [2024-02-23 00:46:01,315: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:46:01.320658837Z [2024-02-23 00:46:01,320: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:46:02.041147936Z [2024-02-23 00:46:02,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c46b2dc8-3a32-46bd-8c01-5d263e48c600] succeeded in 1.4194551780001348s: None 2024-02-23T00:46:02.056024188Z [2024-02-23 00:46:02,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e98c55e3-f35d-4172-9e0a-c87a9c011aaf] succeeded in 1.436645107000004s: None 2024-02-23T00:46:02.416925667Z [2024-02-23 00:46:02,416: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:46:02.419809364Z [2024-02-23 00:46:02,419: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:46:02.420783378Z [2024-02-23 00:46:02,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:46:02.424335218Z [2024-02-23 00:46:02,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:46:02.443186627Z [2024-02-23 00:46:02,442: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:46:02.444931575Z [2024-02-23 00:46:02,444: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:46:02.445079563Z [2024-02-23 00:46:02,444: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:46:02.445330664Z [2024-02-23 00:46:02,445: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:46:02.445498902Z [2024-02-23 00:46:02,445: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:46:02.446096822Z [2024-02-23 00:46:02,445: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:46:02.446312665Z [2024-02-23 00:46:02,446: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:46:02.455958872Z [2024-02-23 00:46:02,455: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:46:02.457857080Z [2024-02-23 00:46:02,457: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:46:02.457989922Z [2024-02-23 00:46:02,457: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:46:02.458205800Z [2024-02-23 00:46:02,457: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:46:02.458322779Z [2024-02-23 00:46:02,458: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:46:02.458687463Z [2024-02-23 00:46:02,458: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:46:02.458811560Z [2024-02-23 00:46:02,458: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:46:02.548329951Z [2024-02-23 00:46:02,548: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:46:02.549232540Z [2024-02-23 00:46:02,548: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:46:04.435595470Z [2024-02-23 00:46:04,435: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5833a6ef-e163-44b9-92c6-1314bedb23ba] succeeded in 3.809004666999499s: None 2024-02-23T00:46:04.683620217Z [2024-02-23 00:46:04,683: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[898cb971-0e1c-48e2-93a0-49363746544d] succeeded in 4.054741870999351s: None 2024-02-23T00:47:00.287582546Z [2024-02-23 00:47:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f3a5c7f-e0ff-49bd-a3ef-a2eb30b495c6] received 2024-02-23T00:47:00.290436229Z [2024-02-23 00:47:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f04daa3b-a9e5-4e13-8a5c-9a7c6228e3cd] received 2024-02-23T00:47:00.294459961Z [2024-02-23 00:47:00,294: INFO/ForkPoolWorker-15] [3f3a5c7f-e0ff-49bd-a3ef-a2eb30b495c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:47:00.296432628Z [2024-02-23 00:47:00,296: INFO/ForkPoolWorker-16] [f04daa3b-a9e5-4e13-8a5c-9a7c6228e3cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:47:00.297896509Z [2024-02-23 00:47:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b569aee-e1c8-483a-9325-132e9a6502cf] received 2024-02-23T00:47:00.307937436Z [2024-02-23 00:47:00,307: INFO/ForkPoolWorker-1] [3b569aee-e1c8-483a-9325-132e9a6502cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:47:00.576513126Z [2024-02-23 00:47:00,573: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:47:00.577308713Z [2024-02-23 00:47:00,574: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:47:00.608475486Z [2024-02-23 00:47:00,605: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:47:00.767685207Z [2024-02-23 00:47:00,767: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:47:00.771957882Z [2024-02-23 00:47:00,771: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:47:00.795983629Z [2024-02-23 00:47:00,795: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:47:00.800042134Z [2024-02-23 00:47:00,799: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:47:00.800492414Z [2024-02-23 00:47:00,800: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:47:00.800887462Z [2024-02-23 00:47:00,800: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:47:00.801267586Z [2024-02-23 00:47:00,801: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:47:00.895902031Z [2024-02-23 00:47:00,895: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:47:01.535710088Z [2024-02-23 00:47:01,535: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b569aee-e1c8-483a-9325-132e9a6502cf] succeeded in 1.2361352299994905s: None 2024-02-23T00:47:01.768465113Z [2024-02-23 00:47:01,768: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:47:01.771985852Z [2024-02-23 00:47:01,771: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:47:01.772141884Z [2024-02-23 00:47:01,771: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:47:01.775488799Z [2024-02-23 00:47:01,775: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:47:01.792505832Z [2024-02-23 00:47:01,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:47:01.793044358Z [2024-02-23 00:47:01,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:47:01.794181060Z [2024-02-23 00:47:01,793: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:47:01.794321045Z [2024-02-23 00:47:01,794: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:47:01.794510023Z [2024-02-23 00:47:01,794: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:47:01.794660144Z [2024-02-23 00:47:01,794: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:47:01.794995681Z [2024-02-23 00:47:01,794: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:47:01.795137112Z [2024-02-23 00:47:01,795: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:47:01.795198320Z [2024-02-23 00:47:01,794: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:47:01.795297881Z [2024-02-23 00:47:01,795: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:47:01.795494474Z [2024-02-23 00:47:01,795: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:47:01.795615770Z [2024-02-23 00:47:01,795: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:47:01.796253168Z [2024-02-23 00:47:01,796: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:47:01.796414074Z [2024-02-23 00:47:01,796: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:47:01.881505310Z [2024-02-23 00:47:01,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:47:01.882027808Z [2024-02-23 00:47:01,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:47:03.449342955Z [2024-02-23 00:47:03,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f3a5c7f-e0ff-49bd-a3ef-a2eb30b495c6] succeeded in 3.159742212999845s: None 2024-02-23T00:47:03.743250648Z [2024-02-23 00:47:03,742: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f04daa3b-a9e5-4e13-8a5c-9a7c6228e3cd] succeeded in 3.4512870520002252s: None 2024-02-23T00:48:01.139758879Z [2024-02-23 00:48:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43a3c656-23f9-4db2-be8a-83204dc69832] received 2024-02-23T00:48:01.146295519Z [2024-02-23 00:48:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3894eb4-a291-42de-b7b0-5fcb3942c8df] received 2024-02-23T00:48:01.151289524Z [2024-02-23 00:48:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0401590-51e4-4bae-8901-ade6cb0ccfa0] received 2024-02-23T00:48:01.153671544Z [2024-02-23 00:48:01,153: INFO/ForkPoolWorker-15] [43a3c656-23f9-4db2-be8a-83204dc69832] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:48:01.158771023Z [2024-02-23 00:48:01,158: INFO/ForkPoolWorker-1] [e0401590-51e4-4bae-8901-ade6cb0ccfa0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:48:01.159207683Z [2024-02-23 00:48:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8faa446f-e909-4f77-8ffb-dc9a3456a51f] received 2024-02-23T00:48:01.159699476Z [2024-02-23 00:48:01,159: INFO/ForkPoolWorker-16] [e3894eb4-a291-42de-b7b0-5fcb3942c8df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:48:01.172564991Z [2024-02-23 00:48:01,172: INFO/ForkPoolWorker-2] [8faa446f-e909-4f77-8ffb-dc9a3456a51f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:48:01.509302456Z [2024-02-23 00:48:01,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:48:01.512797421Z [2024-02-23 00:48:01,509: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:48:01.630205228Z [2024-02-23 00:48:01,627: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:48:01.659859662Z [2024-02-23 00:48:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:48:01.777672365Z [2024-02-23 00:48:01,777: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:48:01.804621845Z [2024-02-23 00:48:01,804: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:48:01.809576523Z [2024-02-23 00:48:01,809: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:48:01.857183014Z [2024-02-23 00:48:01,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:48:01.860381921Z [2024-02-23 00:48:01,860: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:48:01.860402683Z [2024-02-23 00:48:01,860: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:48:01.860428148Z [2024-02-23 00:48:01,860: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:48:01.860630863Z [2024-02-23 00:48:01,860: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:48:02.010748696Z [2024-02-23 00:48:02,010: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:48:02.486787908Z [2024-02-23 00:48:02,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43a3c656-23f9-4db2-be8a-83204dc69832] succeeded in 1.3439225430001898s: None 2024-02-23T00:48:02.792352873Z [2024-02-23 00:48:02,791: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0401590-51e4-4bae-8901-ade6cb0ccfa0] succeeded in 1.6393711990003794s: None 2024-02-23T00:48:02.894048986Z [2024-02-23 00:48:02,893: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:48:02.897454841Z [2024-02-23 00:48:02,896: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:48:02.922071105Z [2024-02-23 00:48:02,921: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:48:02.924089235Z [2024-02-23 00:48:02,923: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:48:02.924355481Z [2024-02-23 00:48:02,924: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:48:02.924753449Z [2024-02-23 00:48:02,924: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:48:02.924998334Z [2024-02-23 00:48:02,924: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:48:02.925630960Z [2024-02-23 00:48:02,925: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:48:02.925932737Z [2024-02-23 00:48:02,925: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:48:03.019564648Z [2024-02-23 00:48:03,019: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:48:03.103451794Z [2024-02-23 00:48:03,103: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:48:03.107197234Z [2024-02-23 00:48:03,106: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:48:03.135035337Z [2024-02-23 00:48:03,134: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:48:03.136705159Z [2024-02-23 00:48:03,136: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:48:03.138972894Z [2024-02-23 00:48:03,136: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:48:03.139241407Z [2024-02-23 00:48:03,138: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:48:03.139446221Z [2024-02-23 00:48:03,139: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:48:03.139892942Z [2024-02-23 00:48:03,139: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:48:03.140452036Z [2024-02-23 00:48:03,140: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:48:03.242984544Z [2024-02-23 00:48:03,242: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:48:05.311102884Z [2024-02-23 00:48:05,310: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8faa446f-e909-4f77-8ffb-dc9a3456a51f] succeeded in 4.150245756000004s: None 2024-02-23T00:48:05.550652744Z [2024-02-23 00:48:05,549: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3894eb4-a291-42de-b7b0-5fcb3942c8df] succeeded in 4.401653372999135s: None 2024-02-23T00:49:01.014482767Z [2024-02-23 00:49:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d718dfe-ea5e-413b-8789-b5c0871199e1] received 2024-02-23T00:49:01.016654983Z [2024-02-23 00:49:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0ac1dc1-14c6-41ca-bf08-f1b2c4685beb] received 2024-02-23T00:49:01.020205652Z [2024-02-23 00:49:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d89b5428-21ce-4b6b-97df-b252a8482710] received 2024-02-23T00:49:01.021060627Z [2024-02-23 00:49:01,020: INFO/ForkPoolWorker-15] [0d718dfe-ea5e-413b-8789-b5c0871199e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:49:01.026599689Z [2024-02-23 00:49:01,026: INFO/ForkPoolWorker-1] [d89b5428-21ce-4b6b-97df-b252a8482710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:49:01.030883595Z [2024-02-23 00:49:01,030: INFO/ForkPoolWorker-16] [b0ac1dc1-14c6-41ca-bf08-f1b2c4685beb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:49:01.314621584Z [2024-02-23 00:49:01,311: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:49:01.358290293Z [2024-02-23 00:49:01,355: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:49:01.361696684Z [2024-02-23 00:49:01,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:49:01.514625043Z [2024-02-23 00:49:01,514: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:49:01.518596958Z [2024-02-23 00:49:01,518: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:49:01.546542012Z [2024-02-23 00:49:01,546: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:49:01.548135943Z [2024-02-23 00:49:01,547: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:49:01.548206306Z [2024-02-23 00:49:01,548: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:49:01.548340480Z [2024-02-23 00:49:01,548: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:49:01.548655774Z [2024-02-23 00:49:01,548: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:49:01.654688210Z [2024-02-23 00:49:01,654: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:49:02.390676320Z [2024-02-23 00:49:02,390: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d718dfe-ea5e-413b-8789-b5c0871199e1] succeeded in 1.3749521939998886s: None 2024-02-23T00:49:02.591310124Z [2024-02-23 00:49:02,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:49:02.595011201Z [2024-02-23 00:49:02,594: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:49:02.618880202Z [2024-02-23 00:49:02,618: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:49:02.622252265Z [2024-02-23 00:49:02,621: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:49:02.631558476Z [2024-02-23 00:49:02,631: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:49:02.633544356Z [2024-02-23 00:49:02,633: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:49:02.633774404Z [2024-02-23 00:49:02,633: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:49:02.634125673Z [2024-02-23 00:49:02,633: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:49:02.634342600Z [2024-02-23 00:49:02,634: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:49:02.634817548Z [2024-02-23 00:49:02,634: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:49:02.635162743Z [2024-02-23 00:49:02,634: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:49:02.643417221Z [2024-02-23 00:49:02,643: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:49:02.645085882Z [2024-02-23 00:49:02,644: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:49:02.645107617Z [2024-02-23 00:49:02,644: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:49:02.645156817Z [2024-02-23 00:49:02,644: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:49:02.645264080Z [2024-02-23 00:49:02,645: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:49:02.645880031Z [2024-02-23 00:49:02,645: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:49:02.645931410Z [2024-02-23 00:49:02,645: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:49:02.714588902Z [2024-02-23 00:49:02,714: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:49:02.759492015Z [2024-02-23 00:49:02,759: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:49:04.398797820Z [2024-02-23 00:49:04,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d89b5428-21ce-4b6b-97df-b252a8482710] succeeded in 3.3767260069998883s: None 2024-02-23T00:49:04.726669035Z [2024-02-23 00:49:04,724: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0ac1dc1-14c6-41ca-bf08-f1b2c4685beb] succeeded in 3.7055743219998476s: None 2024-02-23T00:50:00.631120485Z [2024-02-23 00:50:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f490f100-782b-47e7-be51-3016efd23467] received 2024-02-23T00:50:00.633191198Z [2024-02-23 00:50:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37b9d860-476f-46e5-9f19-bdbfeb04e75b] received 2024-02-23T00:50:00.641479877Z [2024-02-23 00:50:00,641: INFO/ForkPoolWorker-15] [f490f100-782b-47e7-be51-3016efd23467] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:50:00.645320921Z [2024-02-23 00:50:00,645: INFO/ForkPoolWorker-16] [37b9d860-476f-46e5-9f19-bdbfeb04e75b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:50:00.646623288Z [2024-02-23 00:50:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34c98d68-6937-4bc6-8a14-24d7ebbbcf92] received 2024-02-23T00:50:00.655422573Z [2024-02-23 00:50:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[195d8274-c514-4c56-9b2b-4fd6cab78733] received 2024-02-23T00:50:00.655549647Z [2024-02-23 00:50:00,655: INFO/ForkPoolWorker-1] [34c98d68-6937-4bc6-8a14-24d7ebbbcf92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:50:00.660892424Z [2024-02-23 00:50:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90b2a2e6-f568-4eeb-8074-0af1649383f2] received 2024-02-23T00:50:00.666132729Z [2024-02-23 00:50:00,665: INFO/ForkPoolWorker-2] [195d8274-c514-4c56-9b2b-4fd6cab78733] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:50:00.683974833Z [2024-02-23 00:50:00,683: INFO/ForkPoolWorker-3] [90b2a2e6-f568-4eeb-8074-0af1649383f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:50:01.005701550Z [2024-02-23 00:50:01,002: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:50:01.018694265Z [2024-02-23 00:50:01,014: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:50:01.106318258Z [2024-02-23 00:50:01,103: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:50:01.201054966Z [2024-02-23 00:50:01,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:50:01.242104448Z [2024-02-23 00:50:01,241: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:01.287737667Z [2024-02-23 00:50:01,276: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:50:01.558492107Z [2024-02-23 00:50:01,558: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T00:50:01.563042137Z [2024-02-23 00:50:01,562: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:01.586507299Z [2024-02-23 00:50:01,586: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T00:50:01.588684760Z [2024-02-23 00:50:01,588: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:50:01.589630236Z [2024-02-23 00:50:01,588: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:50:01.589921287Z [2024-02-23 00:50:01,589: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T00:50:01.590310800Z [2024-02-23 00:50:01,590: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:50:01.720873503Z [2024-02-23 00:50:01,720: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:01.814763212Z [2024-02-23 00:50:01,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37b9d860-476f-46e5-9f19-bdbfeb04e75b] succeeded in 1.1799598460002017s: None 2024-02-23T00:50:02.396093883Z [2024-02-23 00:50:02,395: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[90b2a2e6-f568-4eeb-8074-0af1649383f2] succeeded in 1.7290239959993414s: None 2024-02-23T00:50:02.494385734Z [2024-02-23 00:50:02,493: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:50:02.497999662Z [2024-02-23 00:50:02,497: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:02.533891419Z [2024-02-23 00:50:02,533: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:50:02.535904154Z [2024-02-23 00:50:02,535: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:50:02.536157780Z [2024-02-23 00:50:02,535: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:50:02.536478999Z [2024-02-23 00:50:02,536: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:50:02.536667620Z [2024-02-23 00:50:02,536: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:50:02.537357138Z [2024-02-23 00:50:02,537: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:50:02.537512606Z [2024-02-23 00:50:02,537: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:50:02.717167873Z [2024-02-23 00:50:02,716: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:02.822373508Z [2024-02-23 00:50:02,821: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:50:02.826781106Z [2024-02-23 00:50:02,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:02.854958538Z [2024-02-23 00:50:02,854: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:50:02.856976539Z [2024-02-23 00:50:02,856: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:50:02.857137258Z [2024-02-23 00:50:02,856: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:50:02.857356805Z [2024-02-23 00:50:02,857: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:50:02.857465010Z [2024-02-23 00:50:02,857: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:50:02.857899125Z [2024-02-23 00:50:02,857: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:50:02.858044521Z [2024-02-23 00:50:02,857: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:50:02.945787767Z [2024-02-23 00:50:02,945: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:50:02.949523841Z [2024-02-23 00:50:02,949: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:02.967218053Z [2024-02-23 00:50:02,966: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:02.989195922Z [2024-02-23 00:50:02,988: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:50:02.990661899Z [2024-02-23 00:50:02,990: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:50:02.990792057Z [2024-02-23 00:50:02,990: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:50:02.991064816Z [2024-02-23 00:50:02,990: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:50:02.991194862Z [2024-02-23 00:50:02,991: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:50:02.991515445Z [2024-02-23 00:50:02,991: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:50:02.991663946Z [2024-02-23 00:50:02,991: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:50:03.162775914Z [2024-02-23 00:50:03,162: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:03.769293576Z [2024-02-23 00:50:03,768: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f490f100-782b-47e7-be51-3016efd23467] succeeded in 3.1364778600000136s: None 2024-02-23T00:50:04.781360429Z [2024-02-23 00:50:04,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56ba69d5-8b4f-421f-b706-3df84381d1bc] received 2024-02-23T00:50:04.793930153Z [2024-02-23 00:50:04,793: INFO/ForkPoolWorker-15] [56ba69d5-8b4f-421f-b706-3df84381d1bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:50:04.953136524Z [2024-02-23 00:50:04,952: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[195d8274-c514-4c56-9b2b-4fd6cab78733] succeeded in 4.295369174999905s: None 2024-02-23T00:50:05.181011245Z [2024-02-23 00:50:05,180: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[34c98d68-6937-4bc6-8a14-24d7ebbbcf92] succeeded in 4.531892887999675s: None 2024-02-23T00:50:05.197605124Z [2024-02-23 00:50:05,193: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:50:06.469911458Z [2024-02-23 00:50:06,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:50:06.473405021Z [2024-02-23 00:50:06,472: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:06.501674489Z [2024-02-23 00:50:06,501: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:50:06.503381589Z [2024-02-23 00:50:06,503: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:50:06.503489752Z [2024-02-23 00:50:06,503: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:50:06.503788508Z [2024-02-23 00:50:06,503: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:50:06.503935966Z [2024-02-23 00:50:06,503: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:50:06.504359955Z [2024-02-23 00:50:06,504: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:50:06.504442838Z [2024-02-23 00:50:06,504: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:50:06.616284936Z [2024-02-23 00:50:06,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:07.364201319Z [2024-02-23 00:50:07,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18687356-7a11-406b-808e-0e685311b8c9] received 2024-02-23T00:50:07.376878710Z [2024-02-23 00:50:07,376: INFO/ForkPoolWorker-16] [18687356-7a11-406b-808e-0e685311b8c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:50:07.449648073Z [2024-02-23 00:50:07,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56ba69d5-8b4f-421f-b706-3df84381d1bc] succeeded in 2.6608035950002886s: None 2024-02-23T00:50:07.679054048Z [2024-02-23 00:50:07,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:50:08.925656654Z [2024-02-23 00:50:08,925: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:50:08.929373449Z [2024-02-23 00:50:08,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:08.946404938Z [2024-02-23 00:50:08,946: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:50:08.947992986Z [2024-02-23 00:50:08,947: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:50:08.948102373Z [2024-02-23 00:50:08,947: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:50:08.948291711Z [2024-02-23 00:50:08,948: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:50:08.948438399Z [2024-02-23 00:50:08,948: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:50:08.948818500Z [2024-02-23 00:50:08,948: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:50:08.948948932Z [2024-02-23 00:50:08,948: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:50:09.040485535Z [2024-02-23 00:50:09,040: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:09.685990313Z [2024-02-23 00:50:09,685: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18687356-7a11-406b-808e-0e685311b8c9] succeeded in 2.3186291309993976s: None 2024-02-23T00:50:09.841076609Z [2024-02-23 00:50:09,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d60853fb-ad15-43de-99d9-6fea24fb2cf4] received 2024-02-23T00:50:09.847317137Z [2024-02-23 00:50:09,847: INFO/ForkPoolWorker-15] [d60853fb-ad15-43de-99d9-6fea24fb2cf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:50:10.160557711Z [2024-02-23 00:50:10,157: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:50:11.276382475Z [2024-02-23 00:50:11,275: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:50:11.279882290Z [2024-02-23 00:50:11,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:50:11.307682241Z [2024-02-23 00:50:11,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:50:11.309325243Z [2024-02-23 00:50:11,308: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:50:11.309343123Z [2024-02-23 00:50:11,309: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:50:11.309357479Z [2024-02-23 00:50:11,309: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:50:11.309431851Z [2024-02-23 00:50:11,309: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:50:11.309698231Z [2024-02-23 00:50:11,309: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:50:11.309725888Z [2024-02-23 00:50:11,309: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:50:11.407393908Z [2024-02-23 00:50:11,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:50:12.045297185Z [2024-02-23 00:50:12,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d60853fb-ad15-43de-99d9-6fea24fb2cf4] succeeded in 2.2036459460005062s: None 2024-02-23T00:51:00.736373826Z [2024-02-23 00:51:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74c2d81d-15b8-444f-a746-842271613199] received 2024-02-23T00:51:00.746577244Z [2024-02-23 00:51:00,746: INFO/ForkPoolWorker-15] [74c2d81d-15b8-444f-a746-842271613199] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:51:00.751958423Z [2024-02-23 00:51:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[798e22a7-7e87-4ab8-9d7b-825433a01e2b] received 2024-02-23T00:51:00.754543830Z [2024-02-23 00:51:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9065cf94-65ff-4a25-a404-4e70450ee917] received 2024-02-23T00:51:00.760371429Z [2024-02-23 00:51:00,760: INFO/ForkPoolWorker-16] [798e22a7-7e87-4ab8-9d7b-825433a01e2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:51:00.772995554Z [2024-02-23 00:51:00,772: INFO/ForkPoolWorker-1] [9065cf94-65ff-4a25-a404-4e70450ee917] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:51:01.126875195Z [2024-02-23 00:51:01,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:51:01.162648453Z [2024-02-23 00:51:01,159: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:51:01.279901968Z [2024-02-23 00:51:01,276: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:51:01.344813220Z [2024-02-23 00:51:01,344: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:51:01.351460598Z [2024-02-23 00:51:01,350: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:51:01.381155212Z [2024-02-23 00:51:01,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:51:01.382532357Z [2024-02-23 00:51:01,382: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:51:01.382781677Z [2024-02-23 00:51:01,382: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:51:01.383028947Z [2024-02-23 00:51:01,382: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:51:01.383364762Z [2024-02-23 00:51:01,383: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:51:01.479039673Z [2024-02-23 00:51:01,478: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:51:02.183969116Z [2024-02-23 00:51:02,183: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9065cf94-65ff-4a25-a404-4e70450ee917] succeeded in 1.4267902159999721s: None 2024-02-23T00:51:02.529126845Z [2024-02-23 00:51:02,528: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:51:02.532742215Z [2024-02-23 00:51:02,532: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:51:02.556301139Z [2024-02-23 00:51:02,556: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:51:02.558353635Z [2024-02-23 00:51:02,558: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:51:02.558474147Z [2024-02-23 00:51:02,558: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:51:02.558682608Z [2024-02-23 00:51:02,558: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:51:02.558794209Z [2024-02-23 00:51:02,558: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:51:02.559264195Z [2024-02-23 00:51:02,559: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:51:02.559406818Z [2024-02-23 00:51:02,559: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:51:02.580146851Z [2024-02-23 00:51:02,579: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:51:02.583730541Z [2024-02-23 00:51:02,583: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:51:02.611224062Z [2024-02-23 00:51:02,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:51:02.612999038Z [2024-02-23 00:51:02,612: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:51:02.613167649Z [2024-02-23 00:51:02,612: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:51:02.613422970Z [2024-02-23 00:51:02,613: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:51:02.613564224Z [2024-02-23 00:51:02,613: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:51:02.613976129Z [2024-02-23 00:51:02,613: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:51:02.614579937Z [2024-02-23 00:51:02,614: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:51:02.665183046Z [2024-02-23 00:51:02,664: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:51:02.715577172Z [2024-02-23 00:51:02,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:51:04.881829605Z [2024-02-23 00:51:04,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74c2d81d-15b8-444f-a746-842271613199] succeeded in 4.143281028000274s: None 2024-02-23T00:51:05.483510834Z [2024-02-23 00:51:05,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[798e22a7-7e87-4ab8-9d7b-825433a01e2b] succeeded in 4.729399802999978s: None 2024-02-23T00:52:00.536934855Z [2024-02-23 00:52:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52f7a72a-745c-4bcd-989e-fbd73c8c2495] received 2024-02-23T00:52:00.540368292Z [2024-02-23 00:52:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04959f06-04ec-46f7-aae0-d55459f55ed7] received 2024-02-23T00:52:00.544597866Z [2024-02-23 00:52:00,544: INFO/ForkPoolWorker-15] [52f7a72a-745c-4bcd-989e-fbd73c8c2495] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:52:00.546649660Z [2024-02-23 00:52:00,546: INFO/ForkPoolWorker-16] [04959f06-04ec-46f7-aae0-d55459f55ed7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:52:00.551845270Z [2024-02-23 00:52:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e981ea4e-33d6-4663-a4b2-87ecad482bd7] received 2024-02-23T00:52:00.556834735Z [2024-02-23 00:52:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1262e6db-4506-4aef-be18-5b8e2c1571f0] received 2024-02-23T00:52:00.563660838Z [2024-02-23 00:52:00,563: INFO/ForkPoolWorker-1] [e981ea4e-33d6-4663-a4b2-87ecad482bd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:52:00.571404875Z [2024-02-23 00:52:00,571: INFO/ForkPoolWorker-2] [1262e6db-4506-4aef-be18-5b8e2c1571f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:52:00.869871126Z [2024-02-23 00:52:00,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:52:00.946763397Z [2024-02-23 00:52:00,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:52:00.979587415Z [2024-02-23 00:52:00,976: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:52:01.072950295Z [2024-02-23 00:52:01,069: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:52:01.127178759Z [2024-02-23 00:52:01,126: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:52:01.137272566Z [2024-02-23 00:52:01,136: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:52:01.146366967Z [2024-02-23 00:52:01,144: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:52:01.183474362Z [2024-02-23 00:52:01,183: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:52:01.189378896Z [2024-02-23 00:52:01,189: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:52:01.189427855Z [2024-02-23 00:52:01,189: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:52:01.189489666Z [2024-02-23 00:52:01,189: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:52:01.189663579Z [2024-02-23 00:52:01,189: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:52:01.349717349Z [2024-02-23 00:52:01,349: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:52:01.797025982Z [2024-02-23 00:52:01,796: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52f7a72a-745c-4bcd-989e-fbd73c8c2495] succeeded in 1.2586790539999129s: None 2024-02-23T00:52:02.076324844Z [2024-02-23 00:52:02,075: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e981ea4e-33d6-4663-a4b2-87ecad482bd7] succeeded in 1.5231110969998554s: None 2024-02-23T00:52:02.343183087Z [2024-02-23 00:52:02,342: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:52:02.346556736Z [2024-02-23 00:52:02,346: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:52:02.372163035Z [2024-02-23 00:52:02,371: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:52:02.374623222Z [2024-02-23 00:52:02,374: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:52:02.374893973Z [2024-02-23 00:52:02,374: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:52:02.375402290Z [2024-02-23 00:52:02,374: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:52:02.375658504Z [2024-02-23 00:52:02,375: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:52:02.376246094Z [2024-02-23 00:52:02,375: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:52:02.376601274Z [2024-02-23 00:52:02,376: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:52:02.387078812Z [2024-02-23 00:52:02,386: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:52:02.390555120Z [2024-02-23 00:52:02,390: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:52:02.420132271Z [2024-02-23 00:52:02,419: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:52:02.422736838Z [2024-02-23 00:52:02,422: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:52:02.423103494Z [2024-02-23 00:52:02,422: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:52:02.423505667Z [2024-02-23 00:52:02,423: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:52:02.423776258Z [2024-02-23 00:52:02,423: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:52:02.424376847Z [2024-02-23 00:52:02,424: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:52:02.424734227Z [2024-02-23 00:52:02,424: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:52:02.471723204Z [2024-02-23 00:52:02,471: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:52:02.550475436Z [2024-02-23 00:52:02,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:52:04.049720012Z [2024-02-23 00:52:04,049: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1262e6db-4506-4aef-be18-5b8e2c1571f0] succeeded in 3.490582956000253s: None 2024-02-23T00:52:04.478292671Z [2024-02-23 00:52:04,477: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04959f06-04ec-46f7-aae0-d55459f55ed7] succeeded in 3.936565922000227s: None 2024-02-23T00:53:00.549295315Z [2024-02-23 00:53:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10c9212e-c5e9-4faf-9eb7-109f7ce834e3] received 2024-02-23T00:53:00.554124628Z [2024-02-23 00:53:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be940a50-120a-4072-beee-248eb548cfee] received 2024-02-23T00:53:00.560389550Z [2024-02-23 00:53:00,560: INFO/ForkPoolWorker-15] [10c9212e-c5e9-4faf-9eb7-109f7ce834e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:53:00.562333060Z [2024-02-23 00:53:00,562: INFO/ForkPoolWorker-16] [be940a50-120a-4072-beee-248eb548cfee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:53:00.566444714Z [2024-02-23 00:53:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3d1c3c3-0da7-4661-8ef6-2f9c29207476] received 2024-02-23T00:53:00.573023507Z [2024-02-23 00:53:00,572: INFO/ForkPoolWorker-1] [d3d1c3c3-0da7-4661-8ef6-2f9c29207476] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:53:00.951964147Z [2024-02-23 00:53:00,948: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:53:01.127742199Z [2024-02-23 00:53:01,124: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:53:01.230213244Z [2024-02-23 00:53:01,226: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:53:01.785948951Z [2024-02-23 00:53:01,785: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:53:01.790662523Z [2024-02-23 00:53:01,790: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:53:02.086201203Z [2024-02-23 00:53:02,085: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:53:02.087640861Z [2024-02-23 00:53:02,087: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:53:02.087749493Z [2024-02-23 00:53:02,087: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:53:02.087921978Z [2024-02-23 00:53:02,087: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:53:02.089754313Z [2024-02-23 00:53:02,089: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:53:02.204420633Z [2024-02-23 00:53:02,204: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:53:03.231279688Z [2024-02-23 00:53:03,230: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:53:03.237913405Z [2024-02-23 00:53:03,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:53:03.292270709Z [2024-02-23 00:53:03,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:53:03.296886054Z [2024-02-23 00:53:03,296: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:53:03.296904990Z [2024-02-23 00:53:03,296: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:53:03.297116688Z [2024-02-23 00:53:03,296: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:53:03.297167140Z [2024-02-23 00:53:03,297: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:53:03.297585856Z [2024-02-23 00:53:03,297: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:53:03.297600892Z [2024-02-23 00:53:03,297: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:53:03.495227882Z [2024-02-23 00:53:03,494: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:53:03.541384019Z [2024-02-23 00:53:03,540: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3d1c3c3-0da7-4661-8ef6-2f9c29207476] succeeded in 2.973164506000103s: None 2024-02-23T00:53:03.754228578Z [2024-02-23 00:53:03,753: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:53:03.759554968Z [2024-02-23 00:53:03,759: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:53:03.811068170Z [2024-02-23 00:53:03,810: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:53:03.812461956Z [2024-02-23 00:53:03,812: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:53:03.812482041Z [2024-02-23 00:53:03,812: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:53:03.812642386Z [2024-02-23 00:53:03,812: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:53:03.812681261Z [2024-02-23 00:53:03,812: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:53:03.812961360Z [2024-02-23 00:53:03,812: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:53:03.812983195Z [2024-02-23 00:53:03,812: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:53:03.915507140Z [2024-02-23 00:53:03,915: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:53:07.097930859Z [2024-02-23 00:53:07,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10c9212e-c5e9-4faf-9eb7-109f7ce834e3] succeeded in 6.544272453000303s: None 2024-02-23T00:53:08.494692103Z [2024-02-23 00:53:08,494: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be940a50-120a-4072-beee-248eb548cfee] succeeded in 7.9384979650003515s: None 2024-02-23T00:54:00.461114794Z [2024-02-23 00:54:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5659fff-b143-4f3a-b0d9-30dfd6a68ed3] received 2024-02-23T00:54:00.462743428Z [2024-02-23 00:54:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71a13521-db40-418a-97c9-cb6fcc48d775] received 2024-02-23T00:54:00.475746210Z [2024-02-23 00:54:00,475: INFO/ForkPoolWorker-15] [b5659fff-b143-4f3a-b0d9-30dfd6a68ed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:54:00.490188134Z [2024-02-23 00:54:00,489: INFO/ForkPoolWorker-16] [71a13521-db40-418a-97c9-cb6fcc48d775] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:54:00.520106269Z [2024-02-23 00:54:00,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54113316-220f-44cf-89dd-ca0d25a5ce91] received 2024-02-23T00:54:00.526488082Z [2024-02-23 00:54:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b3e7e5-7b6c-4696-a253-553a80cddc0c] received 2024-02-23T00:54:00.548192338Z [2024-02-23 00:54:00,547: INFO/ForkPoolWorker-1] [54113316-220f-44cf-89dd-ca0d25a5ce91] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:54:00.551917400Z [2024-02-23 00:54:00,551: INFO/ForkPoolWorker-2] [59b3e7e5-7b6c-4696-a253-553a80cddc0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:54:01.081825257Z [2024-02-23 00:54:01,077: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:54:01.228991703Z [2024-02-23 00:54:01,210: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:54:01.331648474Z [2024-02-23 00:54:01,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:54:01.504703986Z [2024-02-23 00:54:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:54:01.554183917Z [2024-02-23 00:54:01,553: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:54:01.772883025Z [2024-02-23 00:54:01,769: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T00:54:01.774772188Z [2024-02-23 00:54:01,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:54:01.852461059Z [2024-02-23 00:54:01,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:54:01.859768585Z [2024-02-23 00:54:01,859: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:54:01.859980727Z [2024-02-23 00:54:01,859: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:54:01.860112554Z [2024-02-23 00:54:01,859: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T00:54:01.860393791Z [2024-02-23 00:54:01,860: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:54:02.042754627Z [2024-02-23 00:54:02,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:54:02.724547398Z [2024-02-23 00:54:02,724: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54113316-220f-44cf-89dd-ca0d25a5ce91] succeeded in 2.202656346000367s: None 2024-02-23T00:54:03.023676559Z [2024-02-23 00:54:03,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5659fff-b143-4f3a-b0d9-30dfd6a68ed3] succeeded in 2.559714312000324s: None 2024-02-23T00:54:03.558205608Z [2024-02-23 00:54:03,557: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:54:03.562026829Z [2024-02-23 00:54:03,561: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:54:03.595812378Z [2024-02-23 00:54:03,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:54:03.600329527Z [2024-02-23 00:54:03,600: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:54:03.601718789Z [2024-02-23 00:54:03,601: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:54:03.601988381Z [2024-02-23 00:54:03,601: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:54:03.602101803Z [2024-02-23 00:54:03,601: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:54:03.602402866Z [2024-02-23 00:54:03,602: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:54:03.602520651Z [2024-02-23 00:54:03,602: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:54:03.631357990Z [2024-02-23 00:54:03,625: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:54:03.641672104Z [2024-02-23 00:54:03,634: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:54:03.694729695Z [2024-02-23 00:54:03,694: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:54:03.696392759Z [2024-02-23 00:54:03,696: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:54:03.696569798Z [2024-02-23 00:54:03,696: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:54:03.696773303Z [2024-02-23 00:54:03,696: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:54:03.696911511Z [2024-02-23 00:54:03,696: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:54:03.697245471Z [2024-02-23 00:54:03,697: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:54:03.697935871Z [2024-02-23 00:54:03,697: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:54:03.704239560Z [2024-02-23 00:54:03,703: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:54:03.820873362Z [2024-02-23 00:54:03,819: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:54:06.472939809Z [2024-02-23 00:54:06,472: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[59b3e7e5-7b6c-4696-a253-553a80cddc0c] succeeded in 5.942600203000438s: None 2024-02-23T00:54:06.750497641Z [2024-02-23 00:54:06,750: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71a13521-db40-418a-97c9-cb6fcc48d775] succeeded in 6.274396807999437s: None 2024-02-23T00:55:00.793091773Z [2024-02-23 00:55:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ede06966-faaa-4b8e-b2d8-0be31973db0b] received 2024-02-23T00:55:00.796200060Z [2024-02-23 00:55:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89abe9b5-0604-4bf1-bb99-f44a27a7d88a] received 2024-02-23T00:55:00.800190146Z [2024-02-23 00:55:00,799: INFO/ForkPoolWorker-15] [ede06966-faaa-4b8e-b2d8-0be31973db0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:55:00.803231531Z [2024-02-23 00:55:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb3ef179-c70e-4363-b674-9f815f68d61b] received 2024-02-23T00:55:00.806274439Z [2024-02-23 00:55:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[349fcdf4-40cd-4054-bac9-d09f64c78cb0] received 2024-02-23T00:55:00.811189674Z [2024-02-23 00:55:00,810: INFO/ForkPoolWorker-1] [eb3ef179-c70e-4363-b674-9f815f68d61b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:55:00.812884072Z [2024-02-23 00:55:00,812: INFO/ForkPoolWorker-16] [89abe9b5-0604-4bf1-bb99-f44a27a7d88a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:55:00.820795541Z [2024-02-23 00:55:00,814: INFO/ForkPoolWorker-2] [349fcdf4-40cd-4054-bac9-d09f64c78cb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:55:01.158087020Z [2024-02-23 00:55:01,155: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:55:01.219565867Z [2024-02-23 00:55:01,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:55:01.222583404Z [2024-02-23 00:55:01,219: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:55:01.249791640Z [2024-02-23 00:55:01,246: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:55:01.389104774Z [2024-02-23 00:55:01,388: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:55:01.393123883Z [2024-02-23 00:55:01,392: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:01.414161014Z [2024-02-23 00:55:01,413: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:55:01.415623681Z [2024-02-23 00:55:01,415: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:55:01.415829659Z [2024-02-23 00:55:01,415: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:55:01.415993184Z [2024-02-23 00:55:01,415: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:55:01.416309153Z [2024-02-23 00:55:01,416: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:55:01.504130346Z [2024-02-23 00:55:01,503: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:02.078125836Z [2024-02-23 00:55:02,077: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb3ef179-c70e-4363-b674-9f815f68d61b] succeeded in 1.272936507999475s: None 2024-02-23T00:55:02.535047343Z [2024-02-23 00:55:02,534: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:55:02.539095202Z [2024-02-23 00:55:02,538: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:02.548605397Z [2024-02-23 00:55:02,548: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:55:02.553916425Z [2024-02-23 00:55:02,553: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:02.570658525Z [2024-02-23 00:55:02,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:55:02.573753810Z [2024-02-23 00:55:02,573: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:55:02.573777149Z [2024-02-23 00:55:02,573: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:55:02.574518446Z [2024-02-23 00:55:02,573: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:55:02.574694368Z [2024-02-23 00:55:02,574: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:55:02.575094368Z [2024-02-23 00:55:02,574: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:55:02.575134194Z [2024-02-23 00:55:02,575: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:55:02.580496404Z [2024-02-23 00:55:02,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:55:02.581824029Z [2024-02-23 00:55:02,581: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:55:02.581928602Z [2024-02-23 00:55:02,581: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:55:02.582145153Z [2024-02-23 00:55:02,581: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:55:02.582167261Z [2024-02-23 00:55:02,582: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:55:02.582475563Z [2024-02-23 00:55:02,582: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:55:02.582944784Z [2024-02-23 00:55:02,582: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:55:02.673283042Z [2024-02-23 00:55:02,672: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:55:02.677232702Z [2024-02-23 00:55:02,676: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:02.686667994Z [2024-02-23 00:55:02,686: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:02.700599340Z [2024-02-23 00:55:02,700: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:02.701034955Z [2024-02-23 00:55:02,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:55:02.702549029Z [2024-02-23 00:55:02,702: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:55:02.703915382Z [2024-02-23 00:55:02,703: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:55:02.704139549Z [2024-02-23 00:55:02,703: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:55:02.704169776Z [2024-02-23 00:55:02,704: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:55:02.704556380Z [2024-02-23 00:55:02,704: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:55:02.704832362Z [2024-02-23 00:55:02,704: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:55:02.815713917Z [2024-02-23 00:55:02,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:03.578651441Z [2024-02-23 00:55:03,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6207a798-8c0d-4356-a7da-4a012f9726d0] received 2024-02-23T00:55:03.591989032Z [2024-02-23 00:55:03,591: INFO/ForkPoolWorker-1] [6207a798-8c0d-4356-a7da-4a012f9726d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:55:03.637850826Z [2024-02-23 00:55:03,637: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ede06966-faaa-4b8e-b2d8-0be31973db0b] succeeded in 2.842478841999764s: None 2024-02-23T00:55:03.885678407Z [2024-02-23 00:55:03,882: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:55:04.520466726Z [2024-02-23 00:55:04,519: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[349fcdf4-40cd-4054-bac9-d09f64c78cb0] succeeded in 3.711877103999541s: None 2024-02-23T00:55:04.732882948Z [2024-02-23 00:55:04,732: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89abe9b5-0604-4bf1-bb99-f44a27a7d88a] succeeded in 3.934877224000047s: None 2024-02-23T00:55:05.221817870Z [2024-02-23 00:55:05,221: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:55:05.225126593Z [2024-02-23 00:55:05,224: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:05.247402575Z [2024-02-23 00:55:05,247: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:55:05.248953315Z [2024-02-23 00:55:05,248: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:55:05.249090908Z [2024-02-23 00:55:05,248: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:55:05.249290342Z [2024-02-23 00:55:05,249: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:55:05.249405915Z [2024-02-23 00:55:05,249: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:55:05.249694048Z [2024-02-23 00:55:05,249: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:55:05.249812989Z [2024-02-23 00:55:05,249: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:55:05.328098718Z [2024-02-23 00:55:05,327: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:06.004553619Z [2024-02-23 00:55:06,004: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6207a798-8c0d-4356-a7da-4a012f9726d0] succeeded in 2.4226432519999435s: None 2024-02-23T00:55:06.212229601Z [2024-02-23 00:55:06,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e32e43ca-8541-4fb8-bc4b-0fe62c4f94eb] received 2024-02-23T00:55:06.226460728Z [2024-02-23 00:55:06,226: INFO/ForkPoolWorker-15] [e32e43ca-8541-4fb8-bc4b-0fe62c4f94eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T00:55:06.538817278Z [2024-02-23 00:55:06,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:55:07.694707146Z [2024-02-23 00:55:07,694: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:55:07.699129563Z [2024-02-23 00:55:07,698: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:07.726644081Z [2024-02-23 00:55:07,726: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:55:07.728691788Z [2024-02-23 00:55:07,728: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:55:07.728768695Z [2024-02-23 00:55:07,728: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:55:07.728970684Z [2024-02-23 00:55:07,728: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:55:07.729082111Z [2024-02-23 00:55:07,728: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:55:07.729409481Z [2024-02-23 00:55:07,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:55:07.729493725Z [2024-02-23 00:55:07,729: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:55:07.821210852Z [2024-02-23 00:55:07,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:08.517322134Z [2024-02-23 00:55:08,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e32e43ca-8541-4fb8-bc4b-0fe62c4f94eb] succeeded in 2.3012677269998676s: None 2024-02-23T00:55:09.024120167Z [2024-02-23 00:55:09,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ab76183-948c-450f-ab2c-2ad03c952a9c] received 2024-02-23T00:55:09.031360681Z [2024-02-23 00:55:09,031: INFO/ForkPoolWorker-15] [2ab76183-948c-450f-ab2c-2ad03c952a9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T00:55:09.333188377Z [2024-02-23 00:55:09,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T00:55:10.587090236Z [2024-02-23 00:55:10,586: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:55:10.590471950Z [2024-02-23 00:55:10,589: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:55:10.610399485Z [2024-02-23 00:55:10,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:55:10.611932158Z [2024-02-23 00:55:10,611: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:55:10.611951122Z [2024-02-23 00:55:10,611: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:55:10.612096535Z [2024-02-23 00:55:10,611: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:55:10.612153768Z [2024-02-23 00:55:10,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:55:10.612426799Z [2024-02-23 00:55:10,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T00:55:10.612489154Z [2024-02-23 00:55:10,612: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:55:10.727642921Z [2024-02-23 00:55:10,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:55:11.265843787Z [2024-02-23 00:55:11,265: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ab76183-948c-450f-ab2c-2ad03c952a9c] succeeded in 2.239654526000777s: None 2024-02-23T00:56:01.301364613Z [2024-02-23 00:56:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c74bce3e-cbb4-4ee7-87e2-a726522ca969] received 2024-02-23T00:56:01.305490667Z [2024-02-23 00:56:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e09580f-c029-4337-8ecb-e0c931084df4] received 2024-02-23T00:56:01.310450876Z [2024-02-23 00:56:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ee0a92c-1cf7-4c67-9c60-a1c3a5d24fd5] received 2024-02-23T00:56:01.314625502Z [2024-02-23 00:56:01,314: INFO/ForkPoolWorker-15] [c74bce3e-cbb4-4ee7-87e2-a726522ca969] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:56:01.314819375Z [2024-02-23 00:56:01,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c77a18f-e509-42ca-943e-51471549d713] received 2024-02-23T00:56:01.319479559Z [2024-02-23 00:56:01,319: INFO/ForkPoolWorker-16] [8e09580f-c029-4337-8ecb-e0c931084df4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:56:01.327700352Z [2024-02-23 00:56:01,327: INFO/ForkPoolWorker-1] [5ee0a92c-1cf7-4c67-9c60-a1c3a5d24fd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:56:01.332263898Z [2024-02-23 00:56:01,331: INFO/ForkPoolWorker-2] [1c77a18f-e509-42ca-943e-51471549d713] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:56:01.682103279Z [2024-02-23 00:56:01,679: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:56:01.692892825Z [2024-02-23 00:56:01,689: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:56:01.786854150Z [2024-02-23 00:56:01,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:56:01.841601602Z [2024-02-23 00:56:01,841: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:56:01.845468073Z [2024-02-23 00:56:01,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:56:01.878435854Z [2024-02-23 00:56:01,874: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:56:01.883987162Z [2024-02-23 00:56:01,883: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:56:01.886896975Z [2024-02-23 00:56:01,886: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:56:01.887547132Z [2024-02-23 00:56:01,887: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:56:01.887738028Z [2024-02-23 00:56:01,887: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:56:01.888071978Z [2024-02-23 00:56:01,887: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:56:01.986334889Z [2024-02-23 00:56:01,986: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:56:02.079894451Z [2024-02-23 00:56:02,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:56:02.570392187Z [2024-02-23 00:56:02,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e09580f-c029-4337-8ecb-e0c931084df4] succeeded in 1.263413593000223s: None 2024-02-23T00:56:02.709385625Z [2024-02-23 00:56:02,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c74bce3e-cbb4-4ee7-87e2-a726522ca969] succeeded in 1.4025793549999435s: None 2024-02-23T00:56:03.084542222Z [2024-02-23 00:56:03,084: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:56:03.088039091Z [2024-02-23 00:56:03,087: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:56:03.107558073Z [2024-02-23 00:56:03,107: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:56:03.108776046Z [2024-02-23 00:56:03,108: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:56:03.108854306Z [2024-02-23 00:56:03,108: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:56:03.109025717Z [2024-02-23 00:56:03,108: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:56:03.109117440Z [2024-02-23 00:56:03,109: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:56:03.109391806Z [2024-02-23 00:56:03,109: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:56:03.109476168Z [2024-02-23 00:56:03,109: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:56:03.201854003Z [2024-02-23 00:56:03,201: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:56:03.247232894Z [2024-02-23 00:56:03,246: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:56:03.250540392Z [2024-02-23 00:56:03,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:56:03.271988599Z [2024-02-23 00:56:03,271: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:56:03.273414044Z [2024-02-23 00:56:03,273: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:56:03.273582359Z [2024-02-23 00:56:03,273: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:56:03.273802223Z [2024-02-23 00:56:03,273: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:56:03.273948003Z [2024-02-23 00:56:03,273: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:56:03.274333989Z [2024-02-23 00:56:03,274: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:56:03.274483529Z [2024-02-23 00:56:03,274: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:56:03.356726143Z [2024-02-23 00:56:03,356: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:56:05.303847388Z [2024-02-23 00:56:05,303: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c77a18f-e509-42ca-943e-51471549d713] succeeded in 3.987166177999825s: None 2024-02-23T00:56:05.878797332Z [2024-02-23 00:56:05,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ee0a92c-1cf7-4c67-9c60-a1c3a5d24fd5] succeeded in 4.565617738000583s: None 2024-02-23T00:57:00.582672078Z [2024-02-23 00:57:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dde7f040-3e3a-470b-98ed-b23329ae6e34] received 2024-02-23T00:57:00.591824776Z [2024-02-23 00:57:00,591: INFO/ForkPoolWorker-15] [dde7f040-3e3a-470b-98ed-b23329ae6e34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:57:00.595424555Z [2024-02-23 00:57:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19bfb9c4-5428-4031-a728-6433d2d575d1] received 2024-02-23T00:57:00.597880610Z [2024-02-23 00:57:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91557602-bc78-450e-aea6-7eee7141d7aa] received 2024-02-23T00:57:00.605076273Z [2024-02-23 00:57:00,604: INFO/ForkPoolWorker-1] [91557602-bc78-450e-aea6-7eee7141d7aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:57:00.611435836Z [2024-02-23 00:57:00,611: INFO/ForkPoolWorker-16] [19bfb9c4-5428-4031-a728-6433d2d575d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:57:00.918168151Z [2024-02-23 00:57:00,914: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:57:00.921772198Z [2024-02-23 00:57:00,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:57:00.939290460Z [2024-02-23 00:57:00,936: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:57:01.077252681Z [2024-02-23 00:57:01,076: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:57:01.081198022Z [2024-02-23 00:57:01,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:57:01.112369510Z [2024-02-23 00:57:01,112: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:57:01.114797015Z [2024-02-23 00:57:01,114: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:57:01.115164351Z [2024-02-23 00:57:01,114: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:57:01.115432262Z [2024-02-23 00:57:01,115: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:57:01.115760483Z [2024-02-23 00:57:01,115: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:57:01.211365551Z [2024-02-23 00:57:01,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:57:01.915349834Z [2024-02-23 00:57:01,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19bfb9c4-5428-4031-a728-6433d2d575d1] succeeded in 1.3153103479999118s: None 2024-02-23T00:57:02.213420087Z [2024-02-23 00:57:02,212: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:57:02.216882311Z [2024-02-23 00:57:02,216: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:57:02.243157347Z [2024-02-23 00:57:02,242: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:57:02.245405207Z [2024-02-23 00:57:02,245: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:57:02.245667788Z [2024-02-23 00:57:02,245: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:57:02.245934805Z [2024-02-23 00:57:02,245: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:57:02.246028681Z [2024-02-23 00:57:02,245: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:57:02.246744223Z [2024-02-23 00:57:02,246: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:57:02.247135676Z [2024-02-23 00:57:02,246: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:57:02.293097964Z [2024-02-23 00:57:02,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:57:02.296475545Z [2024-02-23 00:57:02,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:57:02.325644182Z [2024-02-23 00:57:02,325: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:57:02.327384366Z [2024-02-23 00:57:02,327: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:57:02.327792498Z [2024-02-23 00:57:02,327: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:57:02.328015770Z [2024-02-23 00:57:02,327: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:57:02.328024729Z [2024-02-23 00:57:02,327: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:57:02.328738387Z [2024-02-23 00:57:02,328: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:57:02.328744463Z [2024-02-23 00:57:02,328: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:57:02.336267427Z [2024-02-23 00:57:02,335: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:57:02.439274018Z [2024-02-23 00:57:02,438: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:57:03.947771947Z [2024-02-23 00:57:03,947: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91557602-bc78-450e-aea6-7eee7141d7aa] succeeded in 3.3482003340004667s: None 2024-02-23T00:57:04.378807248Z [2024-02-23 00:57:04,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dde7f040-3e3a-470b-98ed-b23329ae6e34] succeeded in 3.7942182950000642s: None 2024-02-23T00:58:01.071702854Z [2024-02-23 00:58:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91786320-7961-479a-9030-dea2fb075045] received 2024-02-23T00:58:01.074923989Z [2024-02-23 00:58:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b5351e4-a807-4fb5-a51f-831c59ce4a8c] received 2024-02-23T00:58:01.091474174Z [2024-02-23 00:58:01,091: INFO/ForkPoolWorker-16] [3b5351e4-a807-4fb5-a51f-831c59ce4a8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:58:01.092297325Z [2024-02-23 00:58:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07d8cedc-3d28-403c-aa6e-72752bb9f609] received 2024-02-23T00:58:01.092691329Z [2024-02-23 00:58:01,092: INFO/ForkPoolWorker-15] [91786320-7961-479a-9030-dea2fb075045] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T00:58:01.094158312Z [2024-02-23 00:58:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6f38a09-7845-478e-b98a-240c35d7362b] received 2024-02-23T00:58:01.102325913Z [2024-02-23 00:58:01,101: INFO/ForkPoolWorker-2] [e6f38a09-7845-478e-b98a-240c35d7362b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:58:01.106595295Z [2024-02-23 00:58:01,106: INFO/ForkPoolWorker-1] [07d8cedc-3d28-403c-aa6e-72752bb9f609] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:58:01.433211911Z [2024-02-23 00:58:01,429: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:58:01.519772883Z [2024-02-23 00:58:01,515: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:58:01.558657857Z [2024-02-23 00:58:01,555: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:58:01.590460307Z [2024-02-23 00:58:01,589: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T00:58:01.593405179Z [2024-02-23 00:58:01,592: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:58:01.613652270Z [2024-02-23 00:58:01,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T00:58:01.636496382Z [2024-02-23 00:58:01,636: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:58:01.638998797Z [2024-02-23 00:58:01,638: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:58:01.639109956Z [2024-02-23 00:58:01,638: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:58:01.639220378Z [2024-02-23 00:58:01,639: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T00:58:01.639554402Z [2024-02-23 00:58:01,639: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:58:01.765156899Z [2024-02-23 00:58:01,764: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:58:02.027869470Z [2024-02-23 00:58:02,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:58:02.407216243Z [2024-02-23 00:58:02,406: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b5351e4-a807-4fb5-a51f-831c59ce4a8c] succeeded in 1.3296786939999947s: None 2024-02-23T00:58:02.650114925Z [2024-02-23 00:58:02,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91786320-7961-479a-9030-dea2fb075045] succeeded in 1.5766694559997632s: None 2024-02-23T00:58:02.858577616Z [2024-02-23 00:58:02,858: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T00:58:02.862173489Z [2024-02-23 00:58:02,861: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:58:02.871300596Z [2024-02-23 00:58:02,870: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T00:58:02.874465686Z [2024-02-23 00:58:02,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:58:02.887638992Z [2024-02-23 00:58:02,887: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T00:58:02.889349994Z [2024-02-23 00:58:02,889: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:58:02.889630281Z [2024-02-23 00:58:02,889: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:58:02.890010727Z [2024-02-23 00:58:02,889: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:58:02.890342515Z [2024-02-23 00:58:02,890: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T00:58:02.891152039Z [2024-02-23 00:58:02,890: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:58:02.891393892Z [2024-02-23 00:58:02,891: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:58:02.908151712Z [2024-02-23 00:58:02,907: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:58:02.911450127Z [2024-02-23 00:58:02,911: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:58:02.911504429Z [2024-02-23 00:58:02,911: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:58:02.911712509Z [2024-02-23 00:58:02,911: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:58:02.911778844Z [2024-02-23 00:58:02,911: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T00:58:02.912096219Z [2024-02-23 00:58:02,911: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:58:02.912189019Z [2024-02-23 00:58:02,912: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:58:02.971250408Z [2024-02-23 00:58:02,970: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:58:03.015026967Z [2024-02-23 00:58:03,014: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:58:04.858781280Z [2024-02-23 00:58:04,858: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e6f38a09-7845-478e-b98a-240c35d7362b] succeeded in 3.7625196260005396s: None 2024-02-23T00:58:05.868669969Z [2024-02-23 00:58:05,868: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07d8cedc-3d28-403c-aa6e-72752bb9f609] succeeded in 4.774593745999482s: None 2024-02-23T00:59:01.044594822Z [2024-02-23 00:59:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51262208-84f9-4919-bdec-9e07e0c6266f] received 2024-02-23T00:59:01.052986044Z [2024-02-23 00:59:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f5d9e6e-5769-4a9e-8bd0-cbee067dd418] received 2024-02-23T00:59:01.055793900Z [2024-02-23 00:59:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31b12ba6-97ba-45b6-8b74-eb5ab80b74c9] received 2024-02-23T00:59:01.058051423Z [2024-02-23 00:59:01,057: INFO/ForkPoolWorker-15] [51262208-84f9-4919-bdec-9e07e0c6266f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T00:59:01.066456159Z [2024-02-23 00:59:01,066: INFO/ForkPoolWorker-16] [9f5d9e6e-5769-4a9e-8bd0-cbee067dd418] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T00:59:01.069478462Z [2024-02-23 00:59:01,069: INFO/ForkPoolWorker-1] [31b12ba6-97ba-45b6-8b74-eb5ab80b74c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T00:59:01.394570240Z [2024-02-23 00:59:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T00:59:01.618868344Z [2024-02-23 00:59:01,615: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T00:59:01.676425591Z [2024-02-23 00:59:01,673: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T00:59:01.890508523Z [2024-02-23 00:59:01,890: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T00:59:01.894739491Z [2024-02-23 00:59:01,894: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:59:01.925888932Z [2024-02-23 00:59:01,925: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T00:59:01.927007970Z [2024-02-23 00:59:01,926: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T00:59:01.927032492Z [2024-02-23 00:59:01,926: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T00:59:01.927084143Z [2024-02-23 00:59:01,927: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T00:59:01.927273456Z [2024-02-23 00:59:01,927: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T00:59:02.062895304Z [2024-02-23 00:59:02,062: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:59:02.758375388Z [2024-02-23 00:59:02,758: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T00:59:02.761824731Z [2024-02-23 00:59:02,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:59:02.795862755Z [2024-02-23 00:59:02,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T00:59:02.798560165Z [2024-02-23 00:59:02,798: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:59:02.798582608Z [2024-02-23 00:59:02,798: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:59:02.799351887Z [2024-02-23 00:59:02,799: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:59:02.799401403Z [2024-02-23 00:59:02,799: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T00:59:02.799721774Z [2024-02-23 00:59:02,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T00:59:02.799764413Z [2024-02-23 00:59:02,799: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:59:02.852760259Z [2024-02-23 00:59:02,852: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31b12ba6-97ba-45b6-8b74-eb5ab80b74c9] succeeded in 1.795231371999762s: None 2024-02-23T00:59:02.897409216Z [2024-02-23 00:59:02,897: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:59:03.175665579Z [2024-02-23 00:59:03,175: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T00:59:03.178904027Z [2024-02-23 00:59:03,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T00:59:03.201631393Z [2024-02-23 00:59:03,201: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T00:59:03.203133134Z [2024-02-23 00:59:03,202: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T00:59:03.203290872Z [2024-02-23 00:59:03,203: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T00:59:03.203498792Z [2024-02-23 00:59:03,203: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T00:59:03.203658831Z [2024-02-23 00:59:03,203: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T00:59:03.204100183Z [2024-02-23 00:59:03,203: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T00:59:03.204112201Z [2024-02-23 00:59:03,204: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T00:59:03.295388644Z [2024-02-23 00:59:03,295: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T00:59:05.014956687Z [2024-02-23 00:59:05,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51262208-84f9-4919-bdec-9e07e0c6266f] succeeded in 3.968695178999951s: None 2024-02-23T00:59:05.599024575Z [2024-02-23 00:59:05,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f5d9e6e-5769-4a9e-8bd0-cbee067dd418] succeeded in 4.543534808000004s: None 2024-02-23T01:00:01.053334410Z [2024-02-23 01:00:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e605645-4fae-4737-8f8d-d132e78c4b9e] received 2024-02-23T01:00:01.057742182Z [2024-02-23 01:00:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b84b5b1-2155-4100-9cbf-780e8a13f9af] received 2024-02-23T01:00:01.068773600Z [2024-02-23 01:00:01,068: INFO/ForkPoolWorker-15] [7e605645-4fae-4737-8f8d-d132e78c4b9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:00:01.071739954Z [2024-02-23 01:00:01,071: INFO/ForkPoolWorker-16] [5b84b5b1-2155-4100-9cbf-780e8a13f9af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:00:01.080168206Z [2024-02-23 01:00:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[503d1bed-b408-40af-b6d3-c4e5b77ba4e0] received 2024-02-23T01:00:01.092545684Z [2024-02-23 01:00:01,092: INFO/ForkPoolWorker-1] [503d1bed-b408-40af-b6d3-c4e5b77ba4e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:00:01.095554801Z [2024-02-23 01:00:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b81f7b-c777-4747-9342-ef197cf8dc1a] received 2024-02-23T01:00:01.099157659Z [2024-02-23 01:00:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18b8291f-316f-462d-95bd-f4590eadcdf6] received 2024-02-23T01:00:01.113999292Z [2024-02-23 01:00:01,113: INFO/ForkPoolWorker-2] [78b81f7b-c777-4747-9342-ef197cf8dc1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:00:01.117698107Z [2024-02-23 01:00:01,116: INFO/ForkPoolWorker-3] [18b8291f-316f-462d-95bd-f4590eadcdf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:00:01.581570580Z [2024-02-23 01:00:01,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:00:01.606273798Z [2024-02-23 01:00:01,603: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:00:01.653063044Z [2024-02-23 01:00:01,649: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:00:01.655762016Z [2024-02-23 01:00:01,647: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:00:01.900791834Z [2024-02-23 01:00:01,900: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:00:01.910123295Z [2024-02-23 01:00:01,909: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:01.910245207Z [2024-02-23 01:00:01,909: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:01.948802841Z [2024-02-23 01:00:01,948: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:00:01.950145659Z [2024-02-23 01:00:01,949: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:00:01.950581547Z [2024-02-23 01:00:01,950: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:00:01.951054022Z [2024-02-23 01:00:01,950: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:00:01.955903164Z [2024-02-23 01:00:01,955: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:00:02.076978898Z [2024-02-23 01:00:02,076: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:02.092503922Z [2024-02-23 01:00:02,083: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:00:03.083950479Z [2024-02-23 01:00:03,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b84b5b1-2155-4100-9cbf-780e8a13f9af] succeeded in 2.02254652099964s: None 2024-02-23T01:00:03.184112877Z [2024-02-23 01:00:03,183: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[78b81f7b-c777-4747-9342-ef197cf8dc1a] succeeded in 2.085242977999769s: None 2024-02-23T01:00:03.312225523Z [2024-02-23 01:00:03,311: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:00:03.315907476Z [2024-02-23 01:00:03,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:03.356037681Z [2024-02-23 01:00:03,355: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:00:03.364167597Z [2024-02-23 01:00:03,363: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:00:03.364352974Z [2024-02-23 01:00:03,364: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:00:03.364672565Z [2024-02-23 01:00:03,364: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:00:03.364854141Z [2024-02-23 01:00:03,364: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:00:03.365365918Z [2024-02-23 01:00:03,365: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:00:03.365515563Z [2024-02-23 01:00:03,365: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:00:03.444835531Z [2024-02-23 01:00:03,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:03.809355776Z [2024-02-23 01:00:03,808: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:00:03.813206842Z [2024-02-23 01:00:03,812: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:03.844737593Z [2024-02-23 01:00:03,844: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:00:03.846408326Z [2024-02-23 01:00:03,846: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:00:03.846573116Z [2024-02-23 01:00:03,846: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:00:03.846877595Z [2024-02-23 01:00:03,846: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:00:03.847179876Z [2024-02-23 01:00:03,846: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:00:03.848027153Z [2024-02-23 01:00:03,847: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:00:03.848255511Z [2024-02-23 01:00:03,848: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:00:04.009851194Z [2024-02-23 01:00:04,009: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:04.286122597Z [2024-02-23 01:00:04,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e605645-4fae-4737-8f8d-d132e78c4b9e] succeeded in 3.2305391970003257s: None 2024-02-23T01:00:04.378531300Z [2024-02-23 01:00:04,378: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T01:00:04.381884757Z [2024-02-23 01:00:04,381: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:04.406779447Z [2024-02-23 01:00:04,406: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:00:04.408946938Z [2024-02-23 01:00:04,408: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:00:04.409035893Z [2024-02-23 01:00:04,408: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:00:04.409230822Z [2024-02-23 01:00:04,409: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:00:04.409316457Z [2024-02-23 01:00:04,409: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T01:00:04.409607028Z [2024-02-23 01:00:04,409: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:00:04.409716254Z [2024-02-23 01:00:04,409: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:00:04.551848637Z [2024-02-23 01:00:04,551: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:04.880464504Z [2024-02-23 01:00:04,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1ec0014-9606-427a-a9e9-f8a1799610f7] received 2024-02-23T01:00:04.892500640Z [2024-02-23 01:00:04,892: INFO/ForkPoolWorker-15] [a1ec0014-9606-427a-a9e9-f8a1799610f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:00:05.219688149Z [2024-02-23 01:00:05,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:00:06.013340569Z [2024-02-23 01:00:06,012: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[503d1bed-b408-40af-b6d3-c4e5b77ba4e0] succeeded in 4.931367630999375s: None 2024-02-23T01:00:06.237036153Z [2024-02-23 01:00:06,236: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[18b8291f-316f-462d-95bd-f4590eadcdf6] succeeded in 5.132502044999455s: None 2024-02-23T01:00:06.497568523Z [2024-02-23 01:00:06,497: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:00:06.501135108Z [2024-02-23 01:00:06,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:06.524329385Z [2024-02-23 01:00:06,524: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:00:06.525610734Z [2024-02-23 01:00:06,525: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:00:06.525706755Z [2024-02-23 01:00:06,525: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:00:06.525852285Z [2024-02-23 01:00:06,525: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:00:06.525934711Z [2024-02-23 01:00:06,525: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:00:06.526308041Z [2024-02-23 01:00:06,526: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:00:06.526728925Z [2024-02-23 01:00:06,526: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:00:06.624947729Z [2024-02-23 01:00:06,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:07.316836586Z [2024-02-23 01:00:07,316: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1ec0014-9606-427a-a9e9-f8a1799610f7] succeeded in 2.4336038339997685s: None 2024-02-23T01:00:07.379021811Z [2024-02-23 01:00:07,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abc2b68a-dbf0-4c06-bbd1-6f4da83928f8] received 2024-02-23T01:00:07.387632107Z [2024-02-23 01:00:07,387: INFO/ForkPoolWorker-15] [abc2b68a-dbf0-4c06-bbd1-6f4da83928f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:00:07.653183101Z [2024-02-23 01:00:07,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:00:08.834533771Z [2024-02-23 01:00:08,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:00:08.838294455Z [2024-02-23 01:00:08,837: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:08.856616785Z [2024-02-23 01:00:08,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:00:08.858583350Z [2024-02-23 01:00:08,858: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:00:08.858920507Z [2024-02-23 01:00:08,858: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:00:08.859372010Z [2024-02-23 01:00:08,859: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:00:08.859545269Z [2024-02-23 01:00:08,859: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:00:08.860424961Z [2024-02-23 01:00:08,860: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:00:08.860827853Z [2024-02-23 01:00:08,860: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:00:08.960371428Z [2024-02-23 01:00:08,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:09.439962459Z [2024-02-23 01:00:09,439: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abc2b68a-dbf0-4c06-bbd1-6f4da83928f8] succeeded in 2.0593763080005374s: None 2024-02-23T01:00:09.980818807Z [2024-02-23 01:00:09,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5262db1b-6788-4e34-97ae-cc54b6311ba9] received 2024-02-23T01:00:10.022873248Z [2024-02-23 01:00:10,022: INFO/ForkPoolWorker-15] [5262db1b-6788-4e34-97ae-cc54b6311ba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:00:10.289161743Z [2024-02-23 01:00:10,285: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:00:11.499918843Z [2024-02-23 01:00:11,499: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:00:11.504683783Z [2024-02-23 01:00:11,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:00:11.523037153Z [2024-02-23 01:00:11,522: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:00:11.525529502Z [2024-02-23 01:00:11,525: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:00:11.525578757Z [2024-02-23 01:00:11,525: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:00:11.525818799Z [2024-02-23 01:00:11,525: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:00:11.525837929Z [2024-02-23 01:00:11,525: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:00:11.526208779Z [2024-02-23 01:00:11,525: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:00:11.526215657Z [2024-02-23 01:00:11,525: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:00:11.641871358Z [2024-02-23 01:00:11,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:00:12.199174065Z [2024-02-23 01:00:12,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5262db1b-6788-4e34-97ae-cc54b6311ba9] succeeded in 2.212865710999722s: None 2024-02-23T01:01:00.766165358Z [2024-02-23 01:01:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[777f7e9d-0efc-4abd-b7ea-40e41d637bea] received 2024-02-23T01:01:00.774380642Z [2024-02-23 01:01:00,774: INFO/ForkPoolWorker-15] [777f7e9d-0efc-4abd-b7ea-40e41d637bea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:01:00.778324344Z [2024-02-23 01:01:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[935b9636-96d0-4522-bbb8-4d0c3a5d96c0] received 2024-02-23T01:01:00.785211549Z [2024-02-23 01:01:00,784: INFO/ForkPoolWorker-16] [935b9636-96d0-4522-bbb8-4d0c3a5d96c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:01:00.793497465Z [2024-02-23 01:01:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37bf3431-e368-4ace-a08b-57d9759deaf1] received 2024-02-23T01:01:00.807863912Z [2024-02-23 01:01:00,807: INFO/ForkPoolWorker-1] [37bf3431-e368-4ace-a08b-57d9759deaf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:01:01.127992298Z [2024-02-23 01:01:01,124: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:01:01.340793843Z [2024-02-23 01:01:01,336: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:01:01.417174616Z [2024-02-23 01:01:01,407: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:01:01.894214057Z [2024-02-23 01:01:01,893: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:01:01.899764491Z [2024-02-23 01:01:01,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:01:01.933004970Z [2024-02-23 01:01:01,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:01:01.937621411Z [2024-02-23 01:01:01,936: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:01:01.937641201Z [2024-02-23 01:01:01,936: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:01:01.937645340Z [2024-02-23 01:01:01,936: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:01:01.937648735Z [2024-02-23 01:01:01,936: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:01:02.031101225Z [2024-02-23 01:01:02,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:01:02.454987966Z [2024-02-23 01:01:02,454: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:01:02.459053784Z [2024-02-23 01:01:02,458: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:01:02.482905113Z [2024-02-23 01:01:02,482: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:01:02.484363956Z [2024-02-23 01:01:02,484: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:01:02.484475276Z [2024-02-23 01:01:02,484: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:01:02.484623099Z [2024-02-23 01:01:02,484: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:01:02.484705369Z [2024-02-23 01:01:02,484: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:01:02.485055837Z [2024-02-23 01:01:02,484: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:01:02.485215312Z [2024-02-23 01:01:02,485: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:01:02.578172506Z [2024-02-23 01:01:02,577: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:01:02.654726473Z [2024-02-23 01:01:02,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[777f7e9d-0efc-4abd-b7ea-40e41d637bea] succeeded in 1.8865840400003435s: None 2024-02-23T01:01:02.838513023Z [2024-02-23 01:01:02,838: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:01:02.842112635Z [2024-02-23 01:01:02,841: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:01:02.865827894Z [2024-02-23 01:01:02,865: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:01:02.867377093Z [2024-02-23 01:01:02,867: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:01:02.867502358Z [2024-02-23 01:01:02,867: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:01:02.867720918Z [2024-02-23 01:01:02,867: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:01:02.867821583Z [2024-02-23 01:01:02,867: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:01:02.868156719Z [2024-02-23 01:01:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:01:02.868257049Z [2024-02-23 01:01:02,868: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:01:02.949216721Z [2024-02-23 01:01:02,948: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:01:04.478597485Z [2024-02-23 01:01:04,478: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[935b9636-96d0-4522-bbb8-4d0c3a5d96c0] succeeded in 3.6986209269998653s: None 2024-02-23T01:01:05.009777480Z [2024-02-23 01:01:05,009: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37bf3431-e368-4ace-a08b-57d9759deaf1] succeeded in 4.213946405999195s: None 2024-02-23T01:02:00.656598206Z [2024-02-23 01:02:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[526634fc-bcc0-4448-ab1e-f332ae3d7102] received 2024-02-23T01:02:00.664528030Z [2024-02-23 01:02:00,664: INFO/ForkPoolWorker-15] [526634fc-bcc0-4448-ab1e-f332ae3d7102] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:02:00.665288572Z [2024-02-23 01:02:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b2571b1-0c56-4aa0-b73b-4d70faaaaf76] received 2024-02-23T01:02:00.674481954Z [2024-02-23 01:02:00,674: INFO/ForkPoolWorker-16] [7b2571b1-0c56-4aa0-b73b-4d70faaaaf76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:02:00.683469165Z [2024-02-23 01:02:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98b26747-acf9-4a00-a1da-48372dd7ae60] received 2024-02-23T01:02:00.686436856Z [2024-02-23 01:02:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5388594-8fac-4cf0-9248-f66a904170c2] received 2024-02-23T01:02:00.693192887Z [2024-02-23 01:02:00,692: INFO/ForkPoolWorker-2] [f5388594-8fac-4cf0-9248-f66a904170c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:02:00.698855003Z [2024-02-23 01:02:00,698: INFO/ForkPoolWorker-1] [98b26747-acf9-4a00-a1da-48372dd7ae60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:02:01.012036777Z [2024-02-23 01:02:01,008: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:02:01.014706004Z [2024-02-23 01:02:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:02:01.035201734Z [2024-02-23 01:02:01,030: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:02:01.095163547Z [2024-02-23 01:02:01,091: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:02:01.318117195Z [2024-02-23 01:02:01,317: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:02:01.323860958Z [2024-02-23 01:02:01,323: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:02:01.359458347Z [2024-02-23 01:02:01,359: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:02:01.360705439Z [2024-02-23 01:02:01,360: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:02:01.360896855Z [2024-02-23 01:02:01,360: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:02:01.361046515Z [2024-02-23 01:02:01,360: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:02:01.361379639Z [2024-02-23 01:02:01,361: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:02:01.395218590Z [2024-02-23 01:02:01,394: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:02:01.539064546Z [2024-02-23 01:02:01,538: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:02:02.089111698Z [2024-02-23 01:02:02,088: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[526634fc-bcc0-4448-ab1e-f332ae3d7102] succeeded in 1.4297152919998553s: None 2024-02-23T01:02:02.232438121Z [2024-02-23 01:02:02,232: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f5388594-8fac-4cf0-9248-f66a904170c2] succeeded in 1.5442089280004438s: None 2024-02-23T01:02:02.527162530Z [2024-02-23 01:02:02,526: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:02:02.530798764Z [2024-02-23 01:02:02,530: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:02:02.568483996Z [2024-02-23 01:02:02,568: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:02:02.572397472Z [2024-02-23 01:02:02,572: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:02:02.572525667Z [2024-02-23 01:02:02,572: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:02:02.572784428Z [2024-02-23 01:02:02,572: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:02:02.572917420Z [2024-02-23 01:02:02,572: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:02:02.573283445Z [2024-02-23 01:02:02,573: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:02:02.573460063Z [2024-02-23 01:02:02,573: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:02:02.704627309Z [2024-02-23 01:02:02,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:02:02.747682525Z [2024-02-23 01:02:02,747: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:02:02.754068454Z [2024-02-23 01:02:02,753: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:02:02.808334705Z [2024-02-23 01:02:02,808: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:02:02.812250087Z [2024-02-23 01:02:02,811: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:02:02.812416065Z [2024-02-23 01:02:02,812: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:02:02.812692652Z [2024-02-23 01:02:02,812: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:02:02.812855376Z [2024-02-23 01:02:02,812: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:02:02.813221820Z [2024-02-23 01:02:02,813: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:02:02.813327127Z [2024-02-23 01:02:02,813: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:02:02.924437476Z [2024-02-23 01:02:02,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:02:04.448859531Z [2024-02-23 01:02:04,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[98b26747-acf9-4a00-a1da-48372dd7ae60] succeeded in 3.762379996999698s: None 2024-02-23T01:02:04.901693920Z [2024-02-23 01:02:04,901: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b2571b1-0c56-4aa0-b73b-4d70faaaaf76] succeeded in 4.233828761000041s: None 2024-02-23T01:03:00.245731092Z [2024-02-23 01:03:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f0b42d-63ba-499f-b056-ba923ef45a5c] received 2024-02-23T01:03:00.250605358Z [2024-02-23 01:03:00,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd2b4377-e4b9-46db-be46-1c87c11b5c12] received 2024-02-23T01:03:00.253278998Z [2024-02-23 01:03:00,253: INFO/ForkPoolWorker-15] [e0f0b42d-63ba-499f-b056-ba923ef45a5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:03:00.260345092Z [2024-02-23 01:03:00,259: INFO/ForkPoolWorker-16] [fd2b4377-e4b9-46db-be46-1c87c11b5c12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:03:00.267376794Z [2024-02-23 01:03:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be827e70-4e15-43df-bdbf-ef22f65dca83] received 2024-02-23T01:03:00.291673134Z [2024-02-23 01:03:00,291: INFO/ForkPoolWorker-1] [be827e70-4e15-43df-bdbf-ef22f65dca83] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:03:00.545217069Z [2024-02-23 01:03:00,542: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:03:00.545704918Z [2024-02-23 01:03:00,542: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:03:00.595761743Z [2024-02-23 01:03:00,592: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:03:00.761264184Z [2024-02-23 01:03:00,760: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:03:00.765146550Z [2024-02-23 01:03:00,764: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:03:00.794414837Z [2024-02-23 01:03:00,794: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:03:00.796052235Z [2024-02-23 01:03:00,795: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:03:00.796144749Z [2024-02-23 01:03:00,795: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:03:00.796295710Z [2024-02-23 01:03:00,796: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:03:00.796569719Z [2024-02-23 01:03:00,796: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:03:00.899038210Z [2024-02-23 01:03:00,898: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:03:01.581947833Z [2024-02-23 01:03:01,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be827e70-4e15-43df-bdbf-ef22f65dca83] succeeded in 1.3096160800005237s: None 2024-02-23T01:03:01.701503491Z [2024-02-23 01:03:01,701: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:03:01.704978937Z [2024-02-23 01:03:01,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:03:01.727489454Z [2024-02-23 01:03:01,727: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:03:01.729070345Z [2024-02-23 01:03:01,728: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:03:01.729137174Z [2024-02-23 01:03:01,729: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:03:01.729376454Z [2024-02-23 01:03:01,729: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:03:01.729453130Z [2024-02-23 01:03:01,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:03:01.729800758Z [2024-02-23 01:03:01,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:03:01.729857955Z [2024-02-23 01:03:01,729: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:03:01.787744695Z [2024-02-23 01:03:01,787: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:03:01.791297076Z [2024-02-23 01:03:01,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:03:01.823060737Z [2024-02-23 01:03:01,820: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:03:01.823089365Z [2024-02-23 01:03:01,822: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:03:01.823098173Z [2024-02-23 01:03:01,822: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:03:01.823103254Z [2024-02-23 01:03:01,822: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:03:01.823107968Z [2024-02-23 01:03:01,822: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:03:01.823111836Z [2024-02-23 01:03:01,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:03:01.823133706Z [2024-02-23 01:03:01,822: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:03:01.847913596Z [2024-02-23 01:03:01,847: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:03:01.911319849Z [2024-02-23 01:03:01,910: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:03:03.377401168Z [2024-02-23 01:03:03,376: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0f0b42d-63ba-499f-b056-ba923ef45a5c] succeeded in 3.1293293339995216s: None 2024-02-23T01:03:03.946067625Z [2024-02-23 01:03:03,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fd2b4377-e4b9-46db-be46-1c87c11b5c12] succeeded in 3.693198721999579s: None 2024-02-23T01:04:01.305901224Z [2024-02-23 01:04:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[307e4bde-7b46-4bad-9931-cb7313915d97] received 2024-02-23T01:04:01.310699484Z [2024-02-23 01:04:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7018caa-2464-481d-ac75-c463cdcac7a4] received 2024-02-23T01:04:01.319907939Z [2024-02-23 01:04:01,319: INFO/ForkPoolWorker-15] [307e4bde-7b46-4bad-9931-cb7313915d97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:04:01.325082365Z [2024-02-23 01:04:01,324: INFO/ForkPoolWorker-16] [b7018caa-2464-481d-ac75-c463cdcac7a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:04:01.330758193Z [2024-02-23 01:04:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fee0814-d269-43a2-838f-635dfcfb9be8] received 2024-02-23T01:04:01.334315651Z [2024-02-23 01:04:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8383bd2c-f62e-433a-92d4-465694aac950] received 2024-02-23T01:04:01.340907420Z [2024-02-23 01:04:01,340: INFO/ForkPoolWorker-1] [8fee0814-d269-43a2-838f-635dfcfb9be8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:04:01.436410821Z [2024-02-23 01:04:01,436: INFO/ForkPoolWorker-2] [8383bd2c-f62e-433a-92d4-465694aac950] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:04:02.089142228Z [2024-02-23 01:04:02,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:04:02.273468199Z [2024-02-23 01:04:02,250: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:04:02.406072443Z [2024-02-23 01:04:02,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:04:02.603386267Z [2024-02-23 01:04:02,599: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:04:02.955004948Z [2024-02-23 01:04:02,954: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:04:02.964196362Z [2024-02-23 01:04:02,963: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:04:03.103824726Z [2024-02-23 01:04:03,103: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:04:03.109755524Z [2024-02-23 01:04:03,109: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:04:03.109792751Z [2024-02-23 01:04:03,109: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:04:03.109801671Z [2024-02-23 01:04:03,109: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:04:03.110102042Z [2024-02-23 01:04:03,109: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:04:03.251858440Z [2024-02-23 01:04:03,251: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:04:03.279898437Z [2024-02-23 01:04:03,279: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:04:04.399160740Z [2024-02-23 01:04:04,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fee0814-d269-43a2-838f-635dfcfb9be8] succeeded in 3.0665475360001437s: None 2024-02-23T01:04:04.524169358Z [2024-02-23 01:04:04,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:04:04.530724877Z [2024-02-23 01:04:04,530: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:04:04.536105033Z [2024-02-23 01:04:04,535: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8383bd2c-f62e-433a-92d4-465694aac950] succeeded in 3.1679476110002724s: None 2024-02-23T01:04:04.583550707Z [2024-02-23 01:04:04,583: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:04:04.589859202Z [2024-02-23 01:04:04,589: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:04:04.589879663Z [2024-02-23 01:04:04,589: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:04:04.589974176Z [2024-02-23 01:04:04,589: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:04:04.590000033Z [2024-02-23 01:04:04,589: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:04:04.590276035Z [2024-02-23 01:04:04,590: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:04:04.590290079Z [2024-02-23 01:04:04,590: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:04:04.883202006Z [2024-02-23 01:04:04,882: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:04:05.084030316Z [2024-02-23 01:04:05,083: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:04:05.095093783Z [2024-02-23 01:04:05,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:04:05.182446916Z [2024-02-23 01:04:05,182: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:04:05.183824241Z [2024-02-23 01:04:05,183: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:04:05.184628618Z [2024-02-23 01:04:05,183: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:04:05.184888080Z [2024-02-23 01:04:05,184: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:04:05.185018173Z [2024-02-23 01:04:05,184: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:04:05.185912996Z [2024-02-23 01:04:05,185: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:04:05.186466595Z [2024-02-23 01:04:05,186: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:04:05.482340059Z [2024-02-23 01:04:05,476: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:04:07.696259483Z [2024-02-23 01:04:07,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[307e4bde-7b46-4bad-9931-cb7313915d97] succeeded in 6.387863855999967s: None 2024-02-23T01:04:07.767331943Z [2024-02-23 01:04:07,766: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7018caa-2464-481d-ac75-c463cdcac7a4] succeeded in 6.454219864999686s: None 2024-02-23T01:05:01.290552686Z [2024-02-23 01:05:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6437bb63-646c-45f9-a42c-4d9544d12f81] received 2024-02-23T01:05:01.294474926Z [2024-02-23 01:05:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dcb1233-6ff2-45bd-bcb5-70dff8ae2cdb] received 2024-02-23T01:05:01.299071481Z [2024-02-23 01:05:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e39d0e32-58dc-4393-8cc9-5dbb8a84475a] received 2024-02-23T01:05:01.303317543Z [2024-02-23 01:05:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e69388c-beab-4ff8-bc0e-7de2883cb9ec] received 2024-02-23T01:05:01.311049195Z [2024-02-23 01:05:01,310: INFO/ForkPoolWorker-2] [5e69388c-beab-4ff8-bc0e-7de2883cb9ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:05:01.311535536Z [2024-02-23 01:05:01,311: INFO/ForkPoolWorker-1] [e39d0e32-58dc-4393-8cc9-5dbb8a84475a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:05:01.321750965Z [2024-02-23 01:05:01,321: INFO/ForkPoolWorker-16] [1dcb1233-6ff2-45bd-bcb5-70dff8ae2cdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:05:01.323759557Z [2024-02-23 01:05:01,323: INFO/ForkPoolWorker-15] [6437bb63-646c-45f9-a42c-4d9544d12f81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:05:01.686788795Z [2024-02-23 01:05:01,683: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:05:01.698072860Z [2024-02-23 01:05:01,694: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:05:01.731444980Z [2024-02-23 01:05:01,728: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:05:01.749305108Z [2024-02-23 01:05:01,741: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:05:01.918967562Z [2024-02-23 01:05:01,918: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:05:01.923321316Z [2024-02-23 01:05:01,922: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:01.950727414Z [2024-02-23 01:05:01,950: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:05:01.953524050Z [2024-02-23 01:05:01,953: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:05:01.953548227Z [2024-02-23 01:05:01,953: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:05:01.953621782Z [2024-02-23 01:05:01,953: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:05:01.953837337Z [2024-02-23 01:05:01,953: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:05:02.072461154Z [2024-02-23 01:05:02,072: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:02.801755299Z [2024-02-23 01:05:02,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e39d0e32-58dc-4393-8cc9-5dbb8a84475a] succeeded in 1.4997107709996271s: None 2024-02-23T01:05:03.057615450Z [2024-02-23 01:05:03,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:05:03.060946164Z [2024-02-23 01:05:03,060: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:03.092243547Z [2024-02-23 01:05:03,091: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:05:03.093470410Z [2024-02-23 01:05:03,093: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:05:03.093499059Z [2024-02-23 01:05:03,093: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:05:03.093628063Z [2024-02-23 01:05:03,093: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:05:03.093635355Z [2024-02-23 01:05:03,093: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:05:03.093934640Z [2024-02-23 01:05:03,093: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:05:03.094063288Z [2024-02-23 01:05:03,093: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:05:03.200362989Z [2024-02-23 01:05:03,199: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:03.219961382Z [2024-02-23 01:05:03,219: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:05:03.225598034Z [2024-02-23 01:05:03,224: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:03.265002629Z [2024-02-23 01:05:03,264: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:05:03.267720894Z [2024-02-23 01:05:03,267: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:05:03.268065687Z [2024-02-23 01:05:03,267: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:05:03.268409945Z [2024-02-23 01:05:03,268: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:05:03.268687070Z [2024-02-23 01:05:03,268: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:05:03.269295409Z [2024-02-23 01:05:03,268: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:05:03.269552405Z [2024-02-23 01:05:03,269: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:05:03.312444355Z [2024-02-23 01:05:03,312: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:05:03.316757179Z [2024-02-23 01:05:03,316: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:03.337666010Z [2024-02-23 01:05:03,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:05:03.339226032Z [2024-02-23 01:05:03,339: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:05:03.339447611Z [2024-02-23 01:05:03,339: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:05:03.339701427Z [2024-02-23 01:05:03,339: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:05:03.339876993Z [2024-02-23 01:05:03,339: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:05:03.340312068Z [2024-02-23 01:05:03,340: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:05:03.340488856Z [2024-02-23 01:05:03,340: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:05:03.370537583Z [2024-02-23 01:05:03,370: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:03.433580665Z [2024-02-23 01:05:03,433: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:03.901732072Z [2024-02-23 01:05:03,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d637efae-17ab-497b-b58c-5392236e3ed2] received 2024-02-23T01:05:03.911951662Z [2024-02-23 01:05:03,911: INFO/ForkPoolWorker-1] [d637efae-17ab-497b-b58c-5392236e3ed2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:05:03.960324295Z [2024-02-23 01:05:03,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6437bb63-646c-45f9-a42c-4d9544d12f81] succeeded in 2.6553855180000028s: None 2024-02-23T01:05:04.281556301Z [2024-02-23 01:05:04,278: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:05:05.080873182Z [2024-02-23 01:05:05,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1dcb1233-6ff2-45bd-bcb5-70dff8ae2cdb] succeeded in 3.779816349000612s: None 2024-02-23T01:05:05.512847515Z [2024-02-23 01:05:05,512: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:05:05.516314647Z [2024-02-23 01:05:05,515: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:05.541510176Z [2024-02-23 01:05:05,541: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:05:05.543299401Z [2024-02-23 01:05:05,542: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:05:05.543326311Z [2024-02-23 01:05:05,543: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:05:05.543391749Z [2024-02-23 01:05:05,543: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:05:05.543448673Z [2024-02-23 01:05:05,543: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:05:05.543827419Z [2024-02-23 01:05:05,543: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:05:05.543845494Z [2024-02-23 01:05:05,543: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:05:05.629488578Z [2024-02-23 01:05:05,629: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:05.763958827Z [2024-02-23 01:05:05,763: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e69388c-beab-4ff8-bc0e-7de2883cb9ec] succeeded in 4.458294428999579s: None 2024-02-23T01:05:06.344605770Z [2024-02-23 01:05:06,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d637efae-17ab-497b-b58c-5392236e3ed2] succeeded in 2.441211860999829s: None 2024-02-23T01:05:06.374618299Z [2024-02-23 01:05:06,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d6f0b92-e387-42a3-94fd-a0974c7d9db2] received 2024-02-23T01:05:06.385142036Z [2024-02-23 01:05:06,384: INFO/ForkPoolWorker-15] [5d6f0b92-e387-42a3-94fd-a0974c7d9db2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:05:06.703260087Z [2024-02-23 01:05:06,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:05:08.072462511Z [2024-02-23 01:05:08,071: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:05:08.076413042Z [2024-02-23 01:05:08,075: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:08.093820826Z [2024-02-23 01:05:08,093: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:05:08.095161449Z [2024-02-23 01:05:08,094: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:05:08.095408479Z [2024-02-23 01:05:08,095: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:05:08.095555450Z [2024-02-23 01:05:08,095: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:05:08.095615462Z [2024-02-23 01:05:08,095: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:05:08.095909654Z [2024-02-23 01:05:08,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:05:08.096016548Z [2024-02-23 01:05:08,095: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:05:08.201137870Z [2024-02-23 01:05:08,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:08.878058821Z [2024-02-23 01:05:08,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d6f0b92-e387-42a3-94fd-a0974c7d9db2] succeeded in 2.49957145100052s: None 2024-02-23T01:05:09.148364849Z [2024-02-23 01:05:09,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eb72547-6a28-4643-9f67-28bcbcda1c1b] received 2024-02-23T01:05:09.158429148Z [2024-02-23 01:05:09,157: INFO/ForkPoolWorker-15] [8eb72547-6a28-4643-9f67-28bcbcda1c1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:05:09.464302715Z [2024-02-23 01:05:09,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:05:10.662548510Z [2024-02-23 01:05:10,662: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:05:10.666001151Z [2024-02-23 01:05:10,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:05:10.687501245Z [2024-02-23 01:05:10,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:05:10.688730539Z [2024-02-23 01:05:10,688: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:05:10.688780791Z [2024-02-23 01:05:10,688: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:05:10.688896358Z [2024-02-23 01:05:10,688: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:05:10.688953395Z [2024-02-23 01:05:10,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:05:10.689193715Z [2024-02-23 01:05:10,689: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:05:10.689356131Z [2024-02-23 01:05:10,689: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:05:10.788155506Z [2024-02-23 01:05:10,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:05:11.506456153Z [2024-02-23 01:05:11,505: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8eb72547-6a28-4643-9f67-28bcbcda1c1b] succeeded in 2.3553894850001598s: None 2024-02-23T01:06:00.293956925Z [2024-02-23 01:06:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[884a81be-224e-4e6a-922d-1d5a5abc6cc5] received 2024-02-23T01:06:00.301530746Z [2024-02-23 01:06:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[523d5626-b3e5-4ebc-b670-2514cbfb49c1] received 2024-02-23T01:06:00.305791250Z [2024-02-23 01:06:00,305: INFO/ForkPoolWorker-15] [884a81be-224e-4e6a-922d-1d5a5abc6cc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:06:00.311328283Z [2024-02-23 01:06:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6431e861-fe98-4fb0-9f55-81303c22be01] received 2024-02-23T01:06:00.313665301Z [2024-02-23 01:06:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af3de60e-f5e2-4eb7-b9be-f33a7a547b84] received 2024-02-23T01:06:00.319203992Z [2024-02-23 01:06:00,318: INFO/ForkPoolWorker-16] [523d5626-b3e5-4ebc-b670-2514cbfb49c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:06:00.326208576Z [2024-02-23 01:06:00,325: INFO/ForkPoolWorker-2] [af3de60e-f5e2-4eb7-b9be-f33a7a547b84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:06:00.331515554Z [2024-02-23 01:06:00,331: INFO/ForkPoolWorker-1] [6431e861-fe98-4fb0-9f55-81303c22be01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:06:00.605317739Z [2024-02-23 01:06:00,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:06:00.759213121Z [2024-02-23 01:06:00,754: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:06:00.768392232Z [2024-02-23 01:06:00,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:06:00.783372642Z [2024-02-23 01:06:00,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:06:00.857399079Z [2024-02-23 01:06:00,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:06:00.934690898Z [2024-02-23 01:06:00,934: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:06:00.940653134Z [2024-02-23 01:06:00,940: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:06:00.964242815Z [2024-02-23 01:06:00,964: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:06:00.965169183Z [2024-02-23 01:06:00,964: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:06:00.965338115Z [2024-02-23 01:06:00,965: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:06:00.965442390Z [2024-02-23 01:06:00,965: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:06:00.965841485Z [2024-02-23 01:06:00,965: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:06:01.095479246Z [2024-02-23 01:06:01,095: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:06:01.412114155Z [2024-02-23 01:06:01,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[884a81be-224e-4e6a-922d-1d5a5abc6cc5] succeeded in 1.1165098290002788s: None 2024-02-23T01:06:01.733950449Z [2024-02-23 01:06:01,733: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[af3de60e-f5e2-4eb7-b9be-f33a7a547b84] succeeded in 1.417679529000452s: None 2024-02-23T01:06:02.052948419Z [2024-02-23 01:06:02,052: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:06:02.056297490Z [2024-02-23 01:06:02,055: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:06:02.082703727Z [2024-02-23 01:06:02,082: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:06:02.084295158Z [2024-02-23 01:06:02,084: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:06:02.084331310Z [2024-02-23 01:06:02,084: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:06:02.084474384Z [2024-02-23 01:06:02,084: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:06:02.084502488Z [2024-02-23 01:06:02,084: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:06:02.084794413Z [2024-02-23 01:06:02,084: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:06:02.084821263Z [2024-02-23 01:06:02,084: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:06:02.123705231Z [2024-02-23 01:06:02,123: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:06:02.127410853Z [2024-02-23 01:06:02,126: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:06:02.171133347Z [2024-02-23 01:06:02,168: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:06:02.173916381Z [2024-02-23 01:06:02,173: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:06:02.174018529Z [2024-02-23 01:06:02,173: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:06:02.174274064Z [2024-02-23 01:06:02,173: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:06:02.174384608Z [2024-02-23 01:06:02,174: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:06:02.174783651Z [2024-02-23 01:06:02,174: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:06:02.174940225Z [2024-02-23 01:06:02,174: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:06:02.185959324Z [2024-02-23 01:06:02,185: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:06:02.272310513Z [2024-02-23 01:06:02,272: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:06:03.759985317Z [2024-02-23 01:06:03,759: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6431e861-fe98-4fb0-9f55-81303c22be01] succeeded in 3.443870185999913s: None 2024-02-23T01:06:04.249140649Z [2024-02-23 01:06:04,248: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[523d5626-b3e5-4ebc-b670-2514cbfb49c1] succeeded in 3.9433089350004593s: None 2024-02-23T01:07:01.008787902Z [2024-02-23 01:07:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70e3af18-f1de-4bfb-8472-dba34bbfec48] received 2024-02-23T01:07:01.015062263Z [2024-02-23 01:07:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2b9cb3e-ce2b-4cfc-970d-31282cea79d7] received 2024-02-23T01:07:01.015622164Z [2024-02-23 01:07:01,015: INFO/ForkPoolWorker-15] [70e3af18-f1de-4bfb-8472-dba34bbfec48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:07:01.027651933Z [2024-02-23 01:07:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f01818c3-6589-4615-ba29-d633f757aab4] received 2024-02-23T01:07:01.031439453Z [2024-02-23 01:07:01,031: INFO/ForkPoolWorker-16] [a2b9cb3e-ce2b-4cfc-970d-31282cea79d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:07:01.039726704Z [2024-02-23 01:07:01,039: INFO/ForkPoolWorker-1] [f01818c3-6589-4615-ba29-d633f757aab4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:07:01.322498261Z [2024-02-23 01:07:01,319: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:07:01.332602639Z [2024-02-23 01:07:01,329: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:07:01.378350064Z [2024-02-23 01:07:01,375: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:07:01.566709689Z [2024-02-23 01:07:01,566: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:07:01.571141876Z [2024-02-23 01:07:01,570: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:07:01.619878598Z [2024-02-23 01:07:01,619: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:07:01.621090603Z [2024-02-23 01:07:01,620: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:07:01.621327162Z [2024-02-23 01:07:01,621: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:07:01.626427606Z [2024-02-23 01:07:01,621: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:07:01.626951454Z [2024-02-23 01:07:01,626: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:07:01.783486247Z [2024-02-23 01:07:01,783: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:07:02.463773805Z [2024-02-23 01:07:02,463: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2b9cb3e-ce2b-4cfc-970d-31282cea79d7] succeeded in 1.440068687999883s: None 2024-02-23T01:07:02.536239536Z [2024-02-23 01:07:02,535: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:07:02.539566454Z [2024-02-23 01:07:02,539: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:07:02.565464749Z [2024-02-23 01:07:02,565: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:07:02.566997371Z [2024-02-23 01:07:02,566: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:07:02.567092151Z [2024-02-23 01:07:02,566: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:07:02.567221886Z [2024-02-23 01:07:02,566: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:07:02.567240818Z [2024-02-23 01:07:02,567: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:07:02.567591908Z [2024-02-23 01:07:02,567: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:07:02.567601297Z [2024-02-23 01:07:02,567: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:07:02.654842917Z [2024-02-23 01:07:02,654: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:07:02.670680353Z [2024-02-23 01:07:02,670: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:07:02.676141562Z [2024-02-23 01:07:02,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:07:02.712674219Z [2024-02-23 01:07:02,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:07:02.721212454Z [2024-02-23 01:07:02,720: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:07:02.721631301Z [2024-02-23 01:07:02,721: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:07:02.722379452Z [2024-02-23 01:07:02,721: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:07:02.723339764Z [2024-02-23 01:07:02,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:07:02.724510281Z [2024-02-23 01:07:02,723: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:07:02.724585035Z [2024-02-23 01:07:02,724: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:07:02.824984673Z [2024-02-23 01:07:02,824: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:07:04.879058651Z [2024-02-23 01:07:04,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f01818c3-6589-4615-ba29-d633f757aab4] succeeded in 3.8475258620001114s: None 2024-02-23T01:07:05.332464219Z [2024-02-23 01:07:05,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70e3af18-f1de-4bfb-8472-dba34bbfec48] succeeded in 4.321542728000168s: None 2024-02-23T01:08:01.057177133Z [2024-02-23 01:08:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24157c09-91a2-4865-a618-416b48439a32] received 2024-02-23T01:08:01.061233199Z [2024-02-23 01:08:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7102c042-d136-462d-9ce0-ab2be177ee57] received 2024-02-23T01:08:01.068815758Z [2024-02-23 01:08:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f8ba813-c00f-4006-b218-c0ca3cb40d1b] received 2024-02-23T01:08:01.070261421Z [2024-02-23 01:08:01,069: INFO/ForkPoolWorker-16] [7102c042-d136-462d-9ce0-ab2be177ee57] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:08:01.075501479Z [2024-02-23 01:08:01,075: INFO/ForkPoolWorker-1] [6f8ba813-c00f-4006-b218-c0ca3cb40d1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:08:01.076888851Z [2024-02-23 01:08:01,076: INFO/ForkPoolWorker-15] [24157c09-91a2-4865-a618-416b48439a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:08:01.083406856Z [2024-02-23 01:08:01,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[020f760d-458b-4d2f-8659-1e73fd54f34f] received 2024-02-23T01:08:01.092136050Z [2024-02-23 01:08:01,091: INFO/ForkPoolWorker-2] [020f760d-458b-4d2f-8659-1e73fd54f34f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:08:01.375534517Z [2024-02-23 01:08:01,371: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:08:01.436811066Z [2024-02-23 01:08:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:08:01.458985963Z [2024-02-23 01:08:01,455: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:08:01.469233575Z [2024-02-23 01:08:01,465: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:08:01.645674622Z [2024-02-23 01:08:01,645: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:08:01.649723737Z [2024-02-23 01:08:01,649: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:08:01.673196678Z [2024-02-23 01:08:01,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:08:01.686104761Z [2024-02-23 01:08:01,685: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:08:01.688511552Z [2024-02-23 01:08:01,688: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:08:01.688556475Z [2024-02-23 01:08:01,688: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:08:01.688594574Z [2024-02-23 01:08:01,688: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:08:01.688783963Z [2024-02-23 01:08:01,688: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:08:01.843727929Z [2024-02-23 01:08:01,843: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:08:02.476136859Z [2024-02-23 01:08:02,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24157c09-91a2-4865-a618-416b48439a32] succeeded in 1.4123432220003451s: None 2024-02-23T01:08:02.578795419Z [2024-02-23 01:08:02,578: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7102c042-d136-462d-9ce0-ab2be177ee57] succeeded in 1.5156780420002178s: None 2024-02-23T01:08:03.056427665Z [2024-02-23 01:08:03,056: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:08:03.059958008Z [2024-02-23 01:08:03,059: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:08:03.065708270Z [2024-02-23 01:08:03,065: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:08:03.069573953Z [2024-02-23 01:08:03,069: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:08:03.098698903Z [2024-02-23 01:08:03,098: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:08:03.100526848Z [2024-02-23 01:08:03,100: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:08:03.100804892Z [2024-02-23 01:08:03,100: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:08:03.101091104Z [2024-02-23 01:08:03,100: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:08:03.101247875Z [2024-02-23 01:08:03,101: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:08:03.101255746Z [2024-02-23 01:08:03,101: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:08:03.101604549Z [2024-02-23 01:08:03,101: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:08:03.101780670Z [2024-02-23 01:08:03,101: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:08:03.103516001Z [2024-02-23 01:08:03,102: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:08:03.103671788Z [2024-02-23 01:08:03,103: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:08:03.103846408Z [2024-02-23 01:08:03,103: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:08:03.103910229Z [2024-02-23 01:08:03,103: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:08:03.104274966Z [2024-02-23 01:08:03,104: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:08:03.104361375Z [2024-02-23 01:08:03,104: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:08:03.202577120Z [2024-02-23 01:08:03,202: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:08:03.290353510Z [2024-02-23 01:08:03,290: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:08:05.352035423Z [2024-02-23 01:08:05,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[020f760d-458b-4d2f-8659-1e73fd54f34f] succeeded in 4.265397521000523s: None 2024-02-23T01:08:05.790545356Z [2024-02-23 01:08:05,790: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f8ba813-c00f-4006-b218-c0ca3cb40d1b] succeeded in 4.720393941999646s: None 2024-02-23T01:09:01.245413319Z [2024-02-23 01:09:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f3b8ba6-4358-45a4-8206-7a5677b1a884] received 2024-02-23T01:09:01.247977983Z [2024-02-23 01:09:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c46109ec-3e52-44f1-964b-67a012105bec] received 2024-02-23T01:09:01.257411009Z [2024-02-23 01:09:01,257: INFO/ForkPoolWorker-15] [9f3b8ba6-4358-45a4-8206-7a5677b1a884] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:09:01.259264901Z [2024-02-23 01:09:01,258: INFO/ForkPoolWorker-16] [c46109ec-3e52-44f1-964b-67a012105bec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:09:01.264854262Z [2024-02-23 01:09:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a39c02ed-8439-43ac-9c0c-ed65ff42df2e] received 2024-02-23T01:09:01.278243661Z [2024-02-23 01:09:01,277: INFO/ForkPoolWorker-1] [a39c02ed-8439-43ac-9c0c-ed65ff42df2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:09:01.562403500Z [2024-02-23 01:09:01,559: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:09:01.575648341Z [2024-02-23 01:09:01,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:09:01.585673553Z [2024-02-23 01:09:01,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:09:01.741508484Z [2024-02-23 01:09:01,741: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:09:01.745919018Z [2024-02-23 01:09:01,745: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:09:01.767659471Z [2024-02-23 01:09:01,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:09:01.769082025Z [2024-02-23 01:09:01,768: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:09:01.769296221Z [2024-02-23 01:09:01,769: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:09:01.769438081Z [2024-02-23 01:09:01,769: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:09:01.769701720Z [2024-02-23 01:09:01,769: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:09:01.872520218Z [2024-02-23 01:09:01,872: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:09:02.469574867Z [2024-02-23 01:09:02,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f3b8ba6-4358-45a4-8206-7a5677b1a884] succeeded in 1.2194275250003557s: None 2024-02-23T01:09:02.840475139Z [2024-02-23 01:09:02,840: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:09:02.844020127Z [2024-02-23 01:09:02,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:09:02.865425323Z [2024-02-23 01:09:02,865: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:09:02.867129084Z [2024-02-23 01:09:02,866: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:09:02.867149498Z [2024-02-23 01:09:02,867: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:09:02.867458860Z [2024-02-23 01:09:02,867: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:09:02.867541389Z [2024-02-23 01:09:02,867: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:09:02.867860407Z [2024-02-23 01:09:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:09:02.868333308Z [2024-02-23 01:09:02,867: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:09:02.870005936Z [2024-02-23 01:09:02,869: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:09:02.873566499Z [2024-02-23 01:09:02,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:09:02.903262840Z [2024-02-23 01:09:02,902: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:09:02.906556262Z [2024-02-23 01:09:02,906: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:09:02.906954266Z [2024-02-23 01:09:02,906: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:09:02.907384908Z [2024-02-23 01:09:02,906: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:09:02.907606184Z [2024-02-23 01:09:02,907: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:09:02.908096490Z [2024-02-23 01:09:02,907: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:09:02.908428854Z [2024-02-23 01:09:02,908: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:09:02.981551144Z [2024-02-23 01:09:02,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:09:03.021396276Z [2024-02-23 01:09:03,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:09:05.171531990Z [2024-02-23 01:09:05,171: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c46109ec-3e52-44f1-964b-67a012105bec] succeeded in 3.9223079079993113s: None 2024-02-23T01:09:05.443345015Z [2024-02-23 01:09:05,442: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a39c02ed-8439-43ac-9c0c-ed65ff42df2e] succeeded in 4.175779760000296s: None 2024-02-23T01:10:01.256218071Z [2024-02-23 01:10:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96997cc2-0d20-4e2c-92ef-c8fa78dc149e] received 2024-02-23T01:10:01.261285312Z [2024-02-23 01:10:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b8b4307-4cae-4fd0-84b2-e15e18627fd4] received 2024-02-23T01:10:01.263864768Z [2024-02-23 01:10:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf52a897-8bec-4736-b1d3-b4b52484113a] received 2024-02-23T01:10:01.265064955Z [2024-02-23 01:10:01,264: INFO/ForkPoolWorker-15] [96997cc2-0d20-4e2c-92ef-c8fa78dc149e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:10:01.276854166Z [2024-02-23 01:10:01,276: INFO/ForkPoolWorker-1] [bf52a897-8bec-4736-b1d3-b4b52484113a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:10:01.278090183Z [2024-02-23 01:10:01,277: INFO/ForkPoolWorker-16] [8b8b4307-4cae-4fd0-84b2-e15e18627fd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:10:01.285643619Z [2024-02-23 01:10:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed69c31d-e616-40e9-a553-977a9fbe038b] received 2024-02-23T01:10:01.295469088Z [2024-02-23 01:10:01,295: INFO/ForkPoolWorker-2] [ed69c31d-e616-40e9-a553-977a9fbe038b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:10:01.303638089Z [2024-02-23 01:10:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b690b30b-3052-455f-80eb-191797d3cfe3] received 2024-02-23T01:10:01.326427938Z [2024-02-23 01:10:01,325: INFO/ForkPoolWorker-3] [b690b30b-3052-455f-80eb-191797d3cfe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:10:01.795273155Z [2024-02-23 01:10:01,789: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:10:01.799997432Z [2024-02-23 01:10:01,794: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:10:01.907787126Z [2024-02-23 01:10:01,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:10:01.969727630Z [2024-02-23 01:10:01,966: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:10:02.015873818Z [2024-02-23 01:10:02,010: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:10:02.306635002Z [2024-02-23 01:10:02,306: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:10:02.335909459Z [2024-02-23 01:10:02,335: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:02.518079146Z [2024-02-23 01:10:02,517: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:10:02.520466387Z [2024-02-23 01:10:02,520: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:10:02.520664705Z [2024-02-23 01:10:02,520: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:10:02.520756308Z [2024-02-23 01:10:02,520: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:10:02.521142118Z [2024-02-23 01:10:02,520: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:10:02.736492066Z [2024-02-23 01:10:02,730: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:02.791997245Z [2024-02-23 01:10:02,791: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:04.059693306Z [2024-02-23 01:10:04,059: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ed69c31d-e616-40e9-a553-977a9fbe038b] succeeded in 2.7718995830000495s: None 2024-02-23T01:10:04.349580622Z [2024-02-23 01:10:04,348: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b8b4307-4cae-4fd0-84b2-e15e18627fd4] succeeded in 3.0825226440001643s: None 2024-02-23T01:10:04.845065434Z [2024-02-23 01:10:04,844: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T01:10:04.859889814Z [2024-02-23 01:10:04,857: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:04.931965052Z [2024-02-23 01:10:04,931: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:10:04.934307167Z [2024-02-23 01:10:04,934: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:10:04.934353583Z [2024-02-23 01:10:04,934: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:10:04.934563314Z [2024-02-23 01:10:04,934: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:10:04.934595067Z [2024-02-23 01:10:04,934: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T01:10:04.935020363Z [2024-02-23 01:10:04,934: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:10:04.935087381Z [2024-02-23 01:10:04,934: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:10:04.974501566Z [2024-02-23 01:10:04,974: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:10:05.003845451Z [2024-02-23 01:10:05,003: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:05.085892070Z [2024-02-23 01:10:05,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:10:05.105668641Z [2024-02-23 01:10:05,104: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:05.107614030Z [2024-02-23 01:10:05,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:05.159980928Z [2024-02-23 01:10:05,159: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:10:05.166312755Z [2024-02-23 01:10:05,165: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:10:05.167016340Z [2024-02-23 01:10:05,166: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:10:05.167432370Z [2024-02-23 01:10:05,167: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:10:05.169162736Z [2024-02-23 01:10:05,168: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:10:05.170094811Z [2024-02-23 01:10:05,169: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:10:05.170344390Z [2024-02-23 01:10:05,170: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:10:05.190502641Z [2024-02-23 01:10:05,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:10:05.192635245Z [2024-02-23 01:10:05,192: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:10:05.192962396Z [2024-02-23 01:10:05,192: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:10:05.193314160Z [2024-02-23 01:10:05,193: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:10:05.193538623Z [2024-02-23 01:10:05,193: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:10:05.194151719Z [2024-02-23 01:10:05,193: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:10:05.194980321Z [2024-02-23 01:10:05,194: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:10:05.640449548Z [2024-02-23 01:10:05,640: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:05.706258482Z [2024-02-23 01:10:05,705: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:06.698666265Z [2024-02-23 01:10:06,698: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96997cc2-0d20-4e2c-92ef-c8fa78dc149e] succeeded in 5.440298837999762s: None 2024-02-23T01:10:07.473051649Z [2024-02-23 01:10:07,472: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b690b30b-3052-455f-80eb-191797d3cfe3] succeeded in 6.166419232999942s: None 2024-02-23T01:10:07.545389719Z [2024-02-23 01:10:07,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2eb6dbf-ab9b-4654-b7a1-a962fdaf6c9d] received 2024-02-23T01:10:07.561609088Z [2024-02-23 01:10:07,561: INFO/ForkPoolWorker-15] [a2eb6dbf-ab9b-4654-b7a1-a962fdaf6c9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:10:07.931021924Z [2024-02-23 01:10:07,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:10:08.640323714Z [2024-02-23 01:10:08,639: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf52a897-8bec-4736-b1d3-b4b52484113a] succeeded in 7.374819493000359s: None 2024-02-23T01:10:09.143649040Z [2024-02-23 01:10:09,143: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:10:09.147270974Z [2024-02-23 01:10:09,146: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:09.165608913Z [2024-02-23 01:10:09,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:10:09.167160721Z [2024-02-23 01:10:09,166: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:10:09.167181245Z [2024-02-23 01:10:09,167: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:10:09.167389081Z [2024-02-23 01:10:09,167: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:10:09.167422926Z [2024-02-23 01:10:09,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:10:09.167746418Z [2024-02-23 01:10:09,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:10:09.167765267Z [2024-02-23 01:10:09,167: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:10:09.272218988Z [2024-02-23 01:10:09,271: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:09.985377507Z [2024-02-23 01:10:09,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2eb6dbf-ab9b-4654-b7a1-a962fdaf6c9d] succeeded in 2.4377883470006054s: None 2024-02-23T01:10:10.092882943Z [2024-02-23 01:10:10,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e9a2455-0645-411d-ae93-c630143ee005] received 2024-02-23T01:10:10.107884343Z [2024-02-23 01:10:10,107: INFO/ForkPoolWorker-15] [4e9a2455-0645-411d-ae93-c630143ee005] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:10:10.414686693Z [2024-02-23 01:10:10,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:10:11.561133765Z [2024-02-23 01:10:11,560: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:10:11.564595893Z [2024-02-23 01:10:11,564: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:11.595346204Z [2024-02-23 01:10:11,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:10:11.597092873Z [2024-02-23 01:10:11,596: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:10:11.597249836Z [2024-02-23 01:10:11,596: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:10:11.597557366Z [2024-02-23 01:10:11,597: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:10:11.598317901Z [2024-02-23 01:10:11,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:10:11.598944736Z [2024-02-23 01:10:11,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:10:11.599094244Z [2024-02-23 01:10:11,598: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:10:11.690801341Z [2024-02-23 01:10:11,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:12.342947953Z [2024-02-23 01:10:12,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e9a2455-0645-411d-ae93-c630143ee005] succeeded in 2.245672020000711s: None 2024-02-23T01:10:13.133281269Z [2024-02-23 01:10:13,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76768704-6079-44be-8b4b-046f66296526] received 2024-02-23T01:10:13.140391505Z [2024-02-23 01:10:13,139: INFO/ForkPoolWorker-15] [76768704-6079-44be-8b4b-046f66296526] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:10:13.405325927Z [2024-02-23 01:10:13,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:10:14.554445435Z [2024-02-23 01:10:14,554: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:10:14.557814010Z [2024-02-23 01:10:14,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:10:14.577363068Z [2024-02-23 01:10:14,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:10:14.580126805Z [2024-02-23 01:10:14,579: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:10:14.580366531Z [2024-02-23 01:10:14,580: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:10:14.580854528Z [2024-02-23 01:10:14,580: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:10:14.581195108Z [2024-02-23 01:10:14,580: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:10:14.581865534Z [2024-02-23 01:10:14,581: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:10:14.582430495Z [2024-02-23 01:10:14,582: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:10:14.679258746Z [2024-02-23 01:10:14,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:10:15.332064282Z [2024-02-23 01:10:15,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76768704-6079-44be-8b4b-046f66296526] succeeded in 2.1969232939991343s: None 2024-02-23T01:11:00.375402985Z [2024-02-23 01:11:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e808b5ac-449b-4884-bbb7-85b64f22ee65] received 2024-02-23T01:11:00.378556043Z [2024-02-23 01:11:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1a82606-aa0b-4b4d-aaf9-fd8c67222075] received 2024-02-23T01:11:00.381152012Z [2024-02-23 01:11:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2785339b-7390-43e3-9d3a-6c205425ae22] received 2024-02-23T01:11:00.399263985Z [2024-02-23 01:11:00,394: INFO/ForkPoolWorker-1] [2785339b-7390-43e3-9d3a-6c205425ae22] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:11:00.399284508Z [2024-02-23 01:11:00,395: INFO/ForkPoolWorker-15] [e808b5ac-449b-4884-bbb7-85b64f22ee65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:11:00.403081133Z [2024-02-23 01:11:00,399: INFO/ForkPoolWorker-16] [d1a82606-aa0b-4b4d-aaf9-fd8c67222075] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:11:00.669851118Z [2024-02-23 01:11:00,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:11:00.722513909Z [2024-02-23 01:11:00,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:11:00.750911484Z [2024-02-23 01:11:00,747: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:11:00.978607707Z [2024-02-23 01:11:00,978: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:11:00.982736133Z [2024-02-23 01:11:00,982: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:11:01.012612702Z [2024-02-23 01:11:01,012: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:11:01.014059722Z [2024-02-23 01:11:01,013: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:11:01.014359860Z [2024-02-23 01:11:01,014: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:11:01.014375334Z [2024-02-23 01:11:01,014: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:11:01.014714905Z [2024-02-23 01:11:01,014: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:11:01.193604868Z [2024-02-23 01:11:01,187: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:11:01.922115796Z [2024-02-23 01:11:01,921: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2785339b-7390-43e3-9d3a-6c205425ae22] succeeded in 1.5335219489998053s: None 2024-02-23T01:11:02.092970546Z [2024-02-23 01:11:02,092: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:11:02.096398402Z [2024-02-23 01:11:02,095: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:11:02.120825666Z [2024-02-23 01:11:02,120: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:11:02.122551109Z [2024-02-23 01:11:02,122: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:11:02.122612437Z [2024-02-23 01:11:02,122: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:11:02.123047388Z [2024-02-23 01:11:02,122: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:11:02.123082746Z [2024-02-23 01:11:02,122: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:11:02.123416388Z [2024-02-23 01:11:02,123: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:11:02.123500964Z [2024-02-23 01:11:02,123: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:11:02.204156619Z [2024-02-23 01:11:02,203: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:11:02.208130589Z [2024-02-23 01:11:02,207: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:11:02.217318613Z [2024-02-23 01:11:02,217: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:11:02.236020249Z [2024-02-23 01:11:02,235: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:11:02.237778657Z [2024-02-23 01:11:02,237: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:11:02.237966136Z [2024-02-23 01:11:02,237: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:11:02.238165674Z [2024-02-23 01:11:02,237: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:11:02.238267310Z [2024-02-23 01:11:02,238: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:11:02.238585670Z [2024-02-23 01:11:02,238: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:11:02.238697933Z [2024-02-23 01:11:02,238: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:11:02.336210595Z [2024-02-23 01:11:02,335: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:11:04.070993826Z [2024-02-23 01:11:04,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e808b5ac-449b-4884-bbb7-85b64f22ee65] succeeded in 3.695700610000131s: None 2024-02-23T01:11:04.215938078Z [2024-02-23 01:11:04,215: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1a82606-aa0b-4b4d-aaf9-fd8c67222075] succeeded in 3.833740131999548s: None 2024-02-23T01:12:00.841472887Z [2024-02-23 01:12:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33872056-11dc-46ae-9799-73c5ec3393cc] received 2024-02-23T01:12:00.845002024Z [2024-02-23 01:12:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a53c6619-703a-43f9-a165-5c6e2d2f6e1f] received 2024-02-23T01:12:00.852006375Z [2024-02-23 01:12:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6ca95dd-06a8-4ec4-9715-17f9367d813b] received 2024-02-23T01:12:00.855864085Z [2024-02-23 01:12:00,855: INFO/ForkPoolWorker-15] [33872056-11dc-46ae-9799-73c5ec3393cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:12:00.859344511Z [2024-02-23 01:12:00,858: INFO/ForkPoolWorker-16] [a53c6619-703a-43f9-a165-5c6e2d2f6e1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:12:00.867389622Z [2024-02-23 01:12:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a72b5893-4ccb-4d5a-87eb-ddac11da60e0] received 2024-02-23T01:12:00.868571413Z [2024-02-23 01:12:00,868: INFO/ForkPoolWorker-1] [c6ca95dd-06a8-4ec4-9715-17f9367d813b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:12:00.880569795Z [2024-02-23 01:12:00,880: INFO/ForkPoolWorker-2] [a72b5893-4ccb-4d5a-87eb-ddac11da60e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:12:01.184316979Z [2024-02-23 01:12:01,180: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:12:01.232995320Z [2024-02-23 01:12:01,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:12:01.252679202Z [2024-02-23 01:12:01,249: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:12:01.267667101Z [2024-02-23 01:12:01,263: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:12:01.467302587Z [2024-02-23 01:12:01,466: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:12:01.472240576Z [2024-02-23 01:12:01,471: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:12:01.524035769Z [2024-02-23 01:12:01,523: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:12:01.527805058Z [2024-02-23 01:12:01,527: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:12:01.527945310Z [2024-02-23 01:12:01,527: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:12:01.528034724Z [2024-02-23 01:12:01,527: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:12:01.528342888Z [2024-02-23 01:12:01,528: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:12:01.637517444Z [2024-02-23 01:12:01,637: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:12:01.819245635Z [2024-02-23 01:12:01,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:12:02.247147379Z [2024-02-23 01:12:02,246: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6ca95dd-06a8-4ec4-9715-17f9367d813b] succeeded in 1.3929419269998107s: None 2024-02-23T01:12:02.533818853Z [2024-02-23 01:12:02,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33872056-11dc-46ae-9799-73c5ec3393cc] succeeded in 1.686924466000164s: None 2024-02-23T01:12:02.701535621Z [2024-02-23 01:12:02,701: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:12:02.705279405Z [2024-02-23 01:12:02,704: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:12:02.726062247Z [2024-02-23 01:12:02,725: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:12:02.727650309Z [2024-02-23 01:12:02,727: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:12:02.727771683Z [2024-02-23 01:12:02,727: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:12:02.727963375Z [2024-02-23 01:12:02,727: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:12:02.728100462Z [2024-02-23 01:12:02,727: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:12:02.728478505Z [2024-02-23 01:12:02,728: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:12:02.728961400Z [2024-02-23 01:12:02,728: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:12:02.831381912Z [2024-02-23 01:12:02,830: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:12:02.936903734Z [2024-02-23 01:12:02,936: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:12:02.940383009Z [2024-02-23 01:12:02,939: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:12:02.982564131Z [2024-02-23 01:12:02,982: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:12:02.984107775Z [2024-02-23 01:12:02,983: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:12:02.984171901Z [2024-02-23 01:12:02,984: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:12:02.984324005Z [2024-02-23 01:12:02,984: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:12:02.984397671Z [2024-02-23 01:12:02,984: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:12:02.984644976Z [2024-02-23 01:12:02,984: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:12:02.984748209Z [2024-02-23 01:12:02,984: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:12:03.072792260Z [2024-02-23 01:12:03,072: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:12:05.452061626Z [2024-02-23 01:12:05,451: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a53c6619-703a-43f9-a165-5c6e2d2f6e1f] succeeded in 4.604899755000588s: None 2024-02-23T01:12:06.203662693Z [2024-02-23 01:12:06,203: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a72b5893-4ccb-4d5a-87eb-ddac11da60e0] succeeded in 5.329183280000507s: None 2024-02-23T01:12:38.817826488Z [2024-02-23 01:12:38,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a22353f4-3f14-4fab-b09f-0a07b5c573f8] received 2024-02-23T01:12:38.830086331Z [2024-02-23 01:12:38,829: INFO/ForkPoolWorker-15] [a22353f4-3f14-4fab-b09f-0a07b5c573f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223011237_969871', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T01:12:39.112616902Z [2024-02-23 01:12:39,109: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T01:12:39.441670904Z [2024-02-23 01:12:39,441: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:12:40.099694134Z [2024-02-23 01:12:40,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a22353f4-3f14-4fab-b09f-0a07b5c573f8] succeeded in 1.2782225089995336s: None 2024-02-23T01:13:00.293423125Z [2024-02-23 01:13:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0502c1da-aab5-4f9f-9211-9652ec9ae894] received 2024-02-23T01:13:00.297792452Z [2024-02-23 01:13:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[519b0285-3bcf-44fd-8c03-28c5015773c6] received 2024-02-23T01:13:00.300950317Z [2024-02-23 01:13:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08e49d7c-2478-41ba-9dd7-d4351b3ff77b] received 2024-02-23T01:13:00.311730942Z [2024-02-23 01:13:00,311: INFO/ForkPoolWorker-15] [0502c1da-aab5-4f9f-9211-9652ec9ae894] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:13:00.312666862Z [2024-02-23 01:13:00,312: INFO/ForkPoolWorker-1] [08e49d7c-2478-41ba-9dd7-d4351b3ff77b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:13:00.313788137Z [2024-02-23 01:13:00,313: INFO/ForkPoolWorker-16] [519b0285-3bcf-44fd-8c03-28c5015773c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:13:00.588336767Z [2024-02-23 01:13:00,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:13:00.601830923Z [2024-02-23 01:13:00,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:13:00.612462988Z [2024-02-23 01:13:00,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:13:00.775560461Z [2024-02-23 01:13:00,775: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:13:00.779837534Z [2024-02-23 01:13:00,779: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:13:00.799749221Z [2024-02-23 01:13:00,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:13:00.801116389Z [2024-02-23 01:13:00,800: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:13:00.801278618Z [2024-02-23 01:13:00,801: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:13:00.801433377Z [2024-02-23 01:13:00,801: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:13:00.801678791Z [2024-02-23 01:13:00,801: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:13:00.912621551Z [2024-02-23 01:13:00,912: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:13:01.579843069Z [2024-02-23 01:13:01,579: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[519b0285-3bcf-44fd-8c03-28c5015773c6] succeeded in 1.2794299990000582s: None 2024-02-23T01:13:01.748711383Z [2024-02-23 01:13:01,748: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:13:01.752122625Z [2024-02-23 01:13:01,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:13:01.756644330Z [2024-02-23 01:13:01,756: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:13:01.760027289Z [2024-02-23 01:13:01,759: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:13:01.775451108Z [2024-02-23 01:13:01,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:13:01.776879772Z [2024-02-23 01:13:01,776: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:13:01.777089244Z [2024-02-23 01:13:01,776: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:13:01.777338205Z [2024-02-23 01:13:01,777: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:13:01.777508953Z [2024-02-23 01:13:01,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:13:01.778023119Z [2024-02-23 01:13:01,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:13:01.778204438Z [2024-02-23 01:13:01,778: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:13:01.792889812Z [2024-02-23 01:13:01,792: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:13:01.794206468Z [2024-02-23 01:13:01,794: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:13:01.794236539Z [2024-02-23 01:13:01,794: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:13:01.794371215Z [2024-02-23 01:13:01,794: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:13:01.794432083Z [2024-02-23 01:13:01,794: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:13:01.794706531Z [2024-02-23 01:13:01,794: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:13:01.794779590Z [2024-02-23 01:13:01,794: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:13:01.875287644Z [2024-02-23 01:13:01,875: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:13:01.895521390Z [2024-02-23 01:13:01,895: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:13:03.415503475Z [2024-02-23 01:13:03,414: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08e49d7c-2478-41ba-9dd7-d4351b3ff77b] succeeded in 3.1110907980000775s: None 2024-02-23T01:13:03.823285461Z [2024-02-23 01:13:03,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0502c1da-aab5-4f9f-9211-9652ec9ae894] succeeded in 3.5243576719994962s: None 2024-02-23T01:14:00.758634085Z [2024-02-23 01:14:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95f94751-a7ab-4f65-b353-c6cf53976b02] received 2024-02-23T01:14:00.764339015Z [2024-02-23 01:14:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad7a37c4-6c57-47cc-b233-60c92a36a20e] received 2024-02-23T01:14:00.789366278Z [2024-02-23 01:14:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6da7f297-5f09-4030-8dcb-4e5950a9b704] received 2024-02-23T01:14:00.790074272Z [2024-02-23 01:14:00,789: INFO/ForkPoolWorker-16] [ad7a37c4-6c57-47cc-b233-60c92a36a20e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:14:00.820237045Z [2024-02-23 01:14:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a771f6f9-a682-4a6b-807b-e1d5f08efdb9] received 2024-02-23T01:14:00.820273550Z [2024-02-23 01:14:00,809: INFO/ForkPoolWorker-15] [95f94751-a7ab-4f65-b353-c6cf53976b02] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:14:00.826941171Z [2024-02-23 01:14:00,826: INFO/ForkPoolWorker-1] [6da7f297-5f09-4030-8dcb-4e5950a9b704] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:14:00.841744127Z [2024-02-23 01:14:00,831: INFO/ForkPoolWorker-2] [a771f6f9-a682-4a6b-807b-e1d5f08efdb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:14:01.214942000Z [2024-02-23 01:14:01,206: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:14:01.250911784Z [2024-02-23 01:14:01,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:14:01.258220344Z [2024-02-23 01:14:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:14:01.397109154Z [2024-02-23 01:14:01,393: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:14:01.466989546Z [2024-02-23 01:14:01,466: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:14:01.471135142Z [2024-02-23 01:14:01,470: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:14:01.507888448Z [2024-02-23 01:14:01,507: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:14:01.509577901Z [2024-02-23 01:14:01,509: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:14:01.509638034Z [2024-02-23 01:14:01,509: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:14:01.509721005Z [2024-02-23 01:14:01,509: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:14:01.510395507Z [2024-02-23 01:14:01,509: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:14:01.659672146Z [2024-02-23 01:14:01,659: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:14:01.858925673Z [2024-02-23 01:14:01,858: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:14:02.510509000Z [2024-02-23 01:14:02,510: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6da7f297-5f09-4030-8dcb-4e5950a9b704] succeeded in 1.7107068730001629s: None 2024-02-23T01:14:02.601457903Z [2024-02-23 01:14:02,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95f94751-a7ab-4f65-b353-c6cf53976b02] succeeded in 1.8385402240000985s: None 2024-02-23T01:14:02.832003076Z [2024-02-23 01:14:02,831: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:14:02.835987198Z [2024-02-23 01:14:02,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:14:02.859278870Z [2024-02-23 01:14:02,859: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:14:02.860753049Z [2024-02-23 01:14:02,860: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:14:02.860978321Z [2024-02-23 01:14:02,860: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:14:02.861133597Z [2024-02-23 01:14:02,860: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:14:02.861312932Z [2024-02-23 01:14:02,861: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:14:02.861658310Z [2024-02-23 01:14:02,861: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:14:02.861868428Z [2024-02-23 01:14:02,861: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:14:02.943236556Z [2024-02-23 01:14:02,942: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:14:02.946449237Z [2024-02-23 01:14:02,945: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:14:02.961213901Z [2024-02-23 01:14:02,960: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:14:02.967314493Z [2024-02-23 01:14:02,967: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:14:02.968399417Z [2024-02-23 01:14:02,968: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:14:02.968429884Z [2024-02-23 01:14:02,968: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:14:02.968616059Z [2024-02-23 01:14:02,968: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:14:02.968682629Z [2024-02-23 01:14:02,968: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:14:02.969137763Z [2024-02-23 01:14:02,968: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:14:02.969257630Z [2024-02-23 01:14:02,969: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:14:03.049023748Z [2024-02-23 01:14:03,048: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:14:04.918738045Z [2024-02-23 01:14:04,918: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad7a37c4-6c57-47cc-b233-60c92a36a20e] succeeded in 4.151051499000459s: None 2024-02-23T01:14:05.615919644Z [2024-02-23 01:14:05,615: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a771f6f9-a682-4a6b-807b-e1d5f08efdb9] succeeded in 4.7939191060004305s: None 2024-02-23T01:14:39.103927074Z [2024-02-23 01:14:39,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52d118d1-0012-4d7a-8360-57f987ddaf73] received 2024-02-23T01:14:39.113824808Z [2024-02-23 01:14:39,113: INFO/ForkPoolWorker-15] [52d118d1-0012-4d7a-8360-57f987ddaf73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223011437_490111', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T01:14:39.395653021Z [2024-02-23 01:14:39,392: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T01:14:39.711880510Z [2024-02-23 01:14:39,711: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:14:40.339630551Z [2024-02-23 01:14:40,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52d118d1-0012-4d7a-8360-57f987ddaf73] succeeded in 1.2332878730003358s: None 2024-02-23T01:15:00.290972266Z [2024-02-23 01:15:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9355021c-616f-4b74-8cb6-fbf01c76af25] received 2024-02-23T01:15:00.296677211Z [2024-02-23 01:15:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aea4c03-7fb2-43e5-9882-81d4bbef8393] received 2024-02-23T01:15:00.297324549Z [2024-02-23 01:15:00,297: INFO/ForkPoolWorker-15] [9355021c-616f-4b74-8cb6-fbf01c76af25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:15:00.299147909Z [2024-02-23 01:15:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41d88f57-62b5-4e21-83b2-68d862f95f19] received 2024-02-23T01:15:00.312974835Z [2024-02-23 01:15:00,312: INFO/ForkPoolWorker-16] [2aea4c03-7fb2-43e5-9882-81d4bbef8393] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:15:00.312991644Z [2024-02-23 01:15:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fb111d5-8d4f-47e4-980e-33ef74daa785] received 2024-02-23T01:15:00.315318468Z [2024-02-23 01:15:00,315: INFO/ForkPoolWorker-1] [41d88f57-62b5-4e21-83b2-68d862f95f19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:15:00.322766775Z [2024-02-23 01:15:00,322: INFO/ForkPoolWorker-2] [9fb111d5-8d4f-47e4-980e-33ef74daa785] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:15:00.621669722Z [2024-02-23 01:15:00,618: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:15:00.658483871Z [2024-02-23 01:15:00,655: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:15:00.727898506Z [2024-02-23 01:15:00,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:15:00.763618949Z [2024-02-23 01:15:00,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:15:00.790086918Z [2024-02-23 01:15:00,789: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:15:00.793922019Z [2024-02-23 01:15:00,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:00.828320061Z [2024-02-23 01:15:00,828: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:15:00.829595967Z [2024-02-23 01:15:00,829: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:15:00.829947810Z [2024-02-23 01:15:00,829: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:15:00.830118988Z [2024-02-23 01:15:00,829: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:15:00.830465025Z [2024-02-23 01:15:00,830: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:15:00.942375713Z [2024-02-23 01:15:00,942: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:01.586951936Z [2024-02-23 01:15:01,586: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2aea4c03-7fb2-43e5-9882-81d4bbef8393] succeeded in 1.2862844219998806s: None 2024-02-23T01:15:01.886110979Z [2024-02-23 01:15:01,885: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:15:01.889461582Z [2024-02-23 01:15:01,889: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:01.909265698Z [2024-02-23 01:15:01,909: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:15:01.910655681Z [2024-02-23 01:15:01,910: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:15:01.910678342Z [2024-02-23 01:15:01,910: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:15:01.910789077Z [2024-02-23 01:15:01,910: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:15:01.910950363Z [2024-02-23 01:15:01,910: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:15:01.911478656Z [2024-02-23 01:15:01,911: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:15:01.911494091Z [2024-02-23 01:15:01,911: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:15:02.027752308Z [2024-02-23 01:15:02,027: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:02.131199650Z [2024-02-23 01:15:02,130: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:15:02.134564597Z [2024-02-23 01:15:02,134: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:02.145330864Z [2024-02-23 01:15:02,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:15:02.148868043Z [2024-02-23 01:15:02,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:02.158041079Z [2024-02-23 01:15:02,157: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:15:02.159848006Z [2024-02-23 01:15:02,159: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:15:02.159941737Z [2024-02-23 01:15:02,159: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:15:02.160118037Z [2024-02-23 01:15:02,159: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:15:02.160183883Z [2024-02-23 01:15:02,160: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:15:02.160483210Z [2024-02-23 01:15:02,160: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:15:02.160578152Z [2024-02-23 01:15:02,160: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:15:02.167544760Z [2024-02-23 01:15:02,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:15:02.168930095Z [2024-02-23 01:15:02,168: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:15:02.169078744Z [2024-02-23 01:15:02,168: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:15:02.169260479Z [2024-02-23 01:15:02,169: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:15:02.169381747Z [2024-02-23 01:15:02,169: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:15:02.169712019Z [2024-02-23 01:15:02,169: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:15:02.169818616Z [2024-02-23 01:15:02,169: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:15:02.273976600Z [2024-02-23 01:15:02,273: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:02.286214737Z [2024-02-23 01:15:02,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:02.906269275Z [2024-02-23 01:15:02,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f332950-c623-46a6-acc3-8d78a143c7d5] received 2024-02-23T01:15:02.914059149Z [2024-02-23 01:15:02,913: INFO/ForkPoolWorker-16] [6f332950-c623-46a6-acc3-8d78a143c7d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:15:02.959822360Z [2024-02-23 01:15:02,959: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41d88f57-62b5-4e21-83b2-68d862f95f19] succeeded in 2.654554683000242s: None 2024-02-23T01:15:03.213373606Z [2024-02-23 01:15:03,209: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:15:03.542478163Z [2024-02-23 01:15:03,541: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9fb111d5-8d4f-47e4-980e-33ef74daa785] succeeded in 3.226930108000488s: None 2024-02-23T01:15:04.178122563Z [2024-02-23 01:15:04,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9355021c-616f-4b74-8cb6-fbf01c76af25] succeeded in 3.8859690589997626s: None 2024-02-23T01:15:04.474938529Z [2024-02-23 01:15:04,474: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:15:04.478630489Z [2024-02-23 01:15:04,478: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:04.504154521Z [2024-02-23 01:15:04,503: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:15:04.505645222Z [2024-02-23 01:15:04,505: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:15:04.505873003Z [2024-02-23 01:15:04,505: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:15:04.506157244Z [2024-02-23 01:15:04,505: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:15:04.506398897Z [2024-02-23 01:15:04,506: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:15:04.506791672Z [2024-02-23 01:15:04,506: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:15:04.507111362Z [2024-02-23 01:15:04,506: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:15:04.584123094Z [2024-02-23 01:15:04,583: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:05.241820083Z [2024-02-23 01:15:05,241: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f332950-c623-46a6-acc3-8d78a143c7d5] succeeded in 2.331808764000016s: None 2024-02-23T01:15:05.464019205Z [2024-02-23 01:15:05,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e468e0ab-78b1-423a-9db4-73de39f439b1] received 2024-02-23T01:15:05.475883183Z [2024-02-23 01:15:05,475: INFO/ForkPoolWorker-15] [e468e0ab-78b1-423a-9db4-73de39f439b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:15:05.771500830Z [2024-02-23 01:15:05,768: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:15:07.091294775Z [2024-02-23 01:15:07,090: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:15:07.100004535Z [2024-02-23 01:15:07,099: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:07.127354657Z [2024-02-23 01:15:07,126: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:15:07.129359000Z [2024-02-23 01:15:07,128: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:15:07.129396488Z [2024-02-23 01:15:07,129: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:15:07.129629591Z [2024-02-23 01:15:07,129: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:15:07.129864557Z [2024-02-23 01:15:07,129: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:15:07.130253795Z [2024-02-23 01:15:07,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:15:07.130409693Z [2024-02-23 01:15:07,130: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:15:07.244724064Z [2024-02-23 01:15:07,244: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:07.820845443Z [2024-02-23 01:15:07,820: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e468e0ab-78b1-423a-9db4-73de39f439b1] succeeded in 2.3527444000001196s: None 2024-02-23T01:15:07.870781334Z [2024-02-23 01:15:07,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec32e671-987b-4cda-b518-5a57b6c55976] received 2024-02-23T01:15:07.880008501Z [2024-02-23 01:15:07,879: INFO/ForkPoolWorker-15] [ec32e671-987b-4cda-b518-5a57b6c55976] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:15:08.259636587Z [2024-02-23 01:15:08,256: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:15:09.437293812Z [2024-02-23 01:15:09,436: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:15:09.440927560Z [2024-02-23 01:15:09,440: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:15:09.464804041Z [2024-02-23 01:15:09,464: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:15:09.466755513Z [2024-02-23 01:15:09,466: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:15:09.466959186Z [2024-02-23 01:15:09,466: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:15:09.467136560Z [2024-02-23 01:15:09,466: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:15:09.467296695Z [2024-02-23 01:15:09,467: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:15:09.467676993Z [2024-02-23 01:15:09,467: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:15:09.467864884Z [2024-02-23 01:15:09,467: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:15:09.551969064Z [2024-02-23 01:15:09,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:15:10.129387966Z [2024-02-23 01:15:10,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec32e671-987b-4cda-b518-5a57b6c55976] succeeded in 2.2578905190002843s: None 2024-02-23T01:16:00.556230305Z [2024-02-23 01:16:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53ed102c-6265-4be0-9095-a850625a4c78] received 2024-02-23T01:16:00.559037198Z [2024-02-23 01:16:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dd3d981-b910-4443-b27f-a217a8569e5b] received 2024-02-23T01:16:00.561485486Z [2024-02-23 01:16:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[726e504b-1619-4cbb-b68f-f29b2469647e] received 2024-02-23T01:16:00.565247794Z [2024-02-23 01:16:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48b3ca3e-58c7-4a87-9a88-22ddf5862b05] received 2024-02-23T01:16:00.572393556Z [2024-02-23 01:16:00,571: INFO/ForkPoolWorker-15] [53ed102c-6265-4be0-9095-a850625a4c78] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:16:00.574016152Z [2024-02-23 01:16:00,573: INFO/ForkPoolWorker-1] [726e504b-1619-4cbb-b68f-f29b2469647e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:16:00.575931647Z [2024-02-23 01:16:00,575: INFO/ForkPoolWorker-2] [48b3ca3e-58c7-4a87-9a88-22ddf5862b05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:16:00.581440300Z [2024-02-23 01:16:00,581: INFO/ForkPoolWorker-16] [1dd3d981-b910-4443-b27f-a217a8569e5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:16:00.935621778Z [2024-02-23 01:16:00,932: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:16:00.937993232Z [2024-02-23 01:16:00,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:16:00.946353124Z [2024-02-23 01:16:00,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:16:00.978207956Z [2024-02-23 01:16:00,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:16:01.207873742Z [2024-02-23 01:16:01,207: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:16:01.212518663Z [2024-02-23 01:16:01,212: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:16:01.239416550Z [2024-02-23 01:16:01,238: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:16:01.240200440Z [2024-02-23 01:16:01,239: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:16:01.240338161Z [2024-02-23 01:16:01,240: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:16:01.240411200Z [2024-02-23 01:16:01,240: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:16:01.240665238Z [2024-02-23 01:16:01,240: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:16:01.352877255Z [2024-02-23 01:16:01,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:16:01.412785745Z [2024-02-23 01:16:01,412: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:16:01.949090470Z [2024-02-23 01:16:01,948: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[726e504b-1619-4cbb-b68f-f29b2469647e] succeeded in 1.3844532459997936s: None 2024-02-23T01:16:02.138223938Z [2024-02-23 01:16:02,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53ed102c-6265-4be0-9095-a850625a4c78] succeeded in 1.5765253999998095s: None 2024-02-23T01:16:02.260568957Z [2024-02-23 01:16:02,260: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:16:02.264405700Z [2024-02-23 01:16:02,263: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:16:02.265831443Z [2024-02-23 01:16:02,265: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:16:02.269870957Z [2024-02-23 01:16:02,269: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:16:02.286416687Z [2024-02-23 01:16:02,286: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:16:02.287861739Z [2024-02-23 01:16:02,287: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:16:02.288035266Z [2024-02-23 01:16:02,287: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:16:02.288309514Z [2024-02-23 01:16:02,288: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:16:02.288450456Z [2024-02-23 01:16:02,288: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:16:02.288803805Z [2024-02-23 01:16:02,288: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:16:02.288999690Z [2024-02-23 01:16:02,288: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:16:02.309742077Z [2024-02-23 01:16:02,309: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:16:02.312186080Z [2024-02-23 01:16:02,311: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:16:02.312252465Z [2024-02-23 01:16:02,312: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:16:02.312430594Z [2024-02-23 01:16:02,312: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:16:02.312684025Z [2024-02-23 01:16:02,312: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:16:02.313108461Z [2024-02-23 01:16:02,312: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:16:02.313274224Z [2024-02-23 01:16:02,313: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:16:02.387614542Z [2024-02-23 01:16:02,387: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:16:02.403062603Z [2024-02-23 01:16:02,402: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:16:03.918007732Z [2024-02-23 01:16:03,917: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[48b3ca3e-58c7-4a87-9a88-22ddf5862b05] succeeded in 3.3506013520000124s: None 2024-02-23T01:16:04.202390190Z [2024-02-23 01:16:04,201: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1dd3d981-b910-4443-b27f-a217a8569e5b] succeeded in 3.6408626819993515s: None 2024-02-23T01:17:01.031998627Z [2024-02-23 01:17:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca28a4e8-39b7-46d6-9254-b54007e83a0e] received 2024-02-23T01:17:01.040321276Z [2024-02-23 01:17:01,039: INFO/ForkPoolWorker-15] [ca28a4e8-39b7-46d6-9254-b54007e83a0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:17:01.046209325Z [2024-02-23 01:17:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[418cf538-f577-4f92-9ea0-65428d3ec4cd] received 2024-02-23T01:17:01.052192264Z [2024-02-23 01:17:01,051: INFO/ForkPoolWorker-16] [418cf538-f577-4f92-9ea0-65428d3ec4cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:17:01.061330379Z [2024-02-23 01:17:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e72aec48-8e87-409b-bb7f-b4d5757a8259] received 2024-02-23T01:17:01.076281230Z [2024-02-23 01:17:01,076: INFO/ForkPoolWorker-1] [e72aec48-8e87-409b-bb7f-b4d5757a8259] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:17:01.392777878Z [2024-02-23 01:17:01,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:17:01.500272857Z [2024-02-23 01:17:01,496: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:17:01.616139523Z [2024-02-23 01:17:01,615: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:17:01.620306905Z [2024-02-23 01:17:01,619: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:17:01.650361735Z [2024-02-23 01:17:01,650: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:17:01.652561216Z [2024-02-23 01:17:01,652: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:17:01.652857177Z [2024-02-23 01:17:01,652: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:17:01.653049140Z [2024-02-23 01:17:01,652: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:17:01.653455297Z [2024-02-23 01:17:01,653: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:17:01.784867410Z [2024-02-23 01:17:01,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:17:01.978673943Z [2024-02-23 01:17:01,975: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:17:02.401460676Z [2024-02-23 01:17:02,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca28a4e8-39b7-46d6-9254-b54007e83a0e] succeeded in 1.36707713099986s: None 2024-02-23T01:17:03.179805549Z [2024-02-23 01:17:03,179: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:17:03.183634682Z [2024-02-23 01:17:03,183: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:17:03.208420947Z [2024-02-23 01:17:03,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:17:03.210120856Z [2024-02-23 01:17:03,209: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:17:03.210138317Z [2024-02-23 01:17:03,210: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:17:03.210303781Z [2024-02-23 01:17:03,210: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:17:03.210371881Z [2024-02-23 01:17:03,210: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:17:03.210703148Z [2024-02-23 01:17:03,210: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:17:03.210717774Z [2024-02-23 01:17:03,210: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:17:03.272715983Z [2024-02-23 01:17:03,272: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:17:03.276173309Z [2024-02-23 01:17:03,275: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:17:03.314613271Z [2024-02-23 01:17:03,314: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:17:03.314929622Z [2024-02-23 01:17:03,314: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:17:03.319386487Z [2024-02-23 01:17:03,319: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:17:03.320404358Z [2024-02-23 01:17:03,319: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:17:03.320594161Z [2024-02-23 01:17:03,320: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:17:03.320699005Z [2024-02-23 01:17:03,320: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:17:03.321987603Z [2024-02-23 01:17:03,321: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:17:03.322117085Z [2024-02-23 01:17:03,321: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:17:03.425629556Z [2024-02-23 01:17:03,425: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:17:05.188634849Z [2024-02-23 01:17:05,188: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[418cf538-f577-4f92-9ea0-65428d3ec4cd] succeeded in 4.1407981199999995s: None 2024-02-23T01:17:05.939385655Z [2024-02-23 01:17:05,938: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e72aec48-8e87-409b-bb7f-b4d5757a8259] succeeded in 4.871220963999804s: None 2024-02-23T01:18:00.188372775Z [2024-02-23 01:18:00,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c461c5a-b2f3-48ac-881e-4e1caa7c6b69] received 2024-02-23T01:18:00.190658265Z [2024-02-23 01:18:00,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67578ac0-33e1-4387-b546-8a2b6daf773a] received 2024-02-23T01:18:00.204005712Z [2024-02-23 01:18:00,203: INFO/ForkPoolWorker-15] [8c461c5a-b2f3-48ac-881e-4e1caa7c6b69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:18:00.205024048Z [2024-02-23 01:18:00,204: INFO/ForkPoolWorker-16] [67578ac0-33e1-4387-b546-8a2b6daf773a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:18:00.216513744Z [2024-02-23 01:18:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e58208d-560a-438c-a143-b2f4e56b63f1] received 2024-02-23T01:18:00.219297233Z [2024-02-23 01:18:00,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[add17573-4528-4677-83a0-7139a0efe624] received 2024-02-23T01:18:00.229531583Z [2024-02-23 01:18:00,229: INFO/ForkPoolWorker-2] [add17573-4528-4677-83a0-7139a0efe624] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:18:00.244696947Z [2024-02-23 01:18:00,244: INFO/ForkPoolWorker-1] [8e58208d-560a-438c-a143-b2f4e56b63f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:18:00.549624304Z [2024-02-23 01:18:00,545: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:18:00.567327381Z [2024-02-23 01:18:00,564: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:18:00.728858900Z [2024-02-23 01:18:00,725: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:18:00.765262241Z [2024-02-23 01:18:00,762: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:18:00.884029040Z [2024-02-23 01:18:00,883: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:18:01.024518300Z [2024-02-23 01:18:01,024: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:18:01.038296243Z [2024-02-23 01:18:01,037: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:18:01.108956616Z [2024-02-23 01:18:01,108: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:18:01.109983491Z [2024-02-23 01:18:01,109: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:18:01.110165097Z [2024-02-23 01:18:01,109: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:18:01.110373780Z [2024-02-23 01:18:01,110: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:18:01.110722872Z [2024-02-23 01:18:01,110: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:18:01.312333071Z [2024-02-23 01:18:01,312: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:18:01.662636154Z [2024-02-23 01:18:01,662: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e58208d-560a-438c-a143-b2f4e56b63f1] succeeded in 1.44252307700026s: None 2024-02-23T01:18:02.019539755Z [2024-02-23 01:18:02,019: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[add17573-4528-4677-83a0-7139a0efe624] succeeded in 1.7970047839999097s: None 2024-02-23T01:18:02.242390716Z [2024-02-23 01:18:02,242: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:18:02.246500566Z [2024-02-23 01:18:02,246: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:18:02.261766923Z [2024-02-23 01:18:02,261: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:18:02.265363099Z [2024-02-23 01:18:02,264: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:18:02.277911893Z [2024-02-23 01:18:02,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:18:02.279475236Z [2024-02-23 01:18:02,279: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:18:02.279495809Z [2024-02-23 01:18:02,279: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:18:02.279612962Z [2024-02-23 01:18:02,279: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:18:02.279659473Z [2024-02-23 01:18:02,279: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:18:02.280071498Z [2024-02-23 01:18:02,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:18:02.280116406Z [2024-02-23 01:18:02,280: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:18:02.319744329Z [2024-02-23 01:18:02,319: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:18:02.327966766Z [2024-02-23 01:18:02,327: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:18:02.328002012Z [2024-02-23 01:18:02,327: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:18:02.328026667Z [2024-02-23 01:18:02,327: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:18:02.328040185Z [2024-02-23 01:18:02,327: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:18:02.328475769Z [2024-02-23 01:18:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:18:02.328515031Z [2024-02-23 01:18:02,328: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:18:02.398399085Z [2024-02-23 01:18:02,398: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:18:02.463115554Z [2024-02-23 01:18:02,462: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:18:04.603480518Z [2024-02-23 01:18:04,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c461c5a-b2f3-48ac-881e-4e1caa7c6b69] succeeded in 4.41139037100038s: None 2024-02-23T01:18:05.588158665Z [2024-02-23 01:18:05,587: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67578ac0-33e1-4387-b546-8a2b6daf773a] succeeded in 5.395268788999601s: None 2024-02-23T01:19:01.193159626Z [2024-02-23 01:19:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14404760-2378-4d75-9c04-0ceb503f71c2] received 2024-02-23T01:19:01.200894250Z [2024-02-23 01:19:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec094dec-7d55-4d0a-b599-8966b75ba6a0] received 2024-02-23T01:19:01.207345913Z [2024-02-23 01:19:01,207: INFO/ForkPoolWorker-15] [14404760-2378-4d75-9c04-0ceb503f71c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:19:01.212595685Z [2024-02-23 01:19:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3d049a8-6146-49ed-af7f-b069340e5c67] received 2024-02-23T01:19:01.227547894Z [2024-02-23 01:19:01,227: INFO/ForkPoolWorker-16] [ec094dec-7d55-4d0a-b599-8966b75ba6a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:19:01.232088449Z [2024-02-23 01:19:01,231: INFO/ForkPoolWorker-1] [a3d049a8-6146-49ed-af7f-b069340e5c67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:19:01.566377338Z [2024-02-23 01:19:01,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:19:01.642812211Z [2024-02-23 01:19:01,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:19:01.655841219Z [2024-02-23 01:19:01,652: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:19:01.828063377Z [2024-02-23 01:19:01,827: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:19:01.832319303Z [2024-02-23 01:19:01,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:19:01.860308886Z [2024-02-23 01:19:01,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:19:01.862081483Z [2024-02-23 01:19:01,861: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:19:01.862247665Z [2024-02-23 01:19:01,862: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:19:01.862410578Z [2024-02-23 01:19:01,862: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:19:01.862921265Z [2024-02-23 01:19:01,862: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:19:01.968514350Z [2024-02-23 01:19:01,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:19:02.590969086Z [2024-02-23 01:19:02,590: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a3d049a8-6146-49ed-af7f-b069340e5c67] succeeded in 1.368473718000132s: None 2024-02-23T01:19:02.840156414Z [2024-02-23 01:19:02,839: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:19:02.843915527Z [2024-02-23 01:19:02,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:19:02.870633463Z [2024-02-23 01:19:02,870: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:19:02.872518720Z [2024-02-23 01:19:02,872: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:19:02.872688010Z [2024-02-23 01:19:02,872: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:19:02.872933916Z [2024-02-23 01:19:02,872: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:19:02.873096288Z [2024-02-23 01:19:02,872: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:19:02.873509873Z [2024-02-23 01:19:02,873: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:19:02.873591795Z [2024-02-23 01:19:02,873: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:19:02.947600051Z [2024-02-23 01:19:02,947: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:19:02.950995061Z [2024-02-23 01:19:02,950: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:19:02.971286412Z [2024-02-23 01:19:02,970: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:19:02.982621359Z [2024-02-23 01:19:02,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:19:02.984456096Z [2024-02-23 01:19:02,984: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:19:02.984496755Z [2024-02-23 01:19:02,984: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:19:02.984719375Z [2024-02-23 01:19:02,984: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:19:02.984745848Z [2024-02-23 01:19:02,984: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:19:02.985146880Z [2024-02-23 01:19:02,984: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:19:02.985200956Z [2024-02-23 01:19:02,985: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:19:03.093671614Z [2024-02-23 01:19:03,093: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:19:04.911419020Z [2024-02-23 01:19:04,910: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec094dec-7d55-4d0a-b599-8966b75ba6a0] succeeded in 3.7008609189997514s: None 2024-02-23T01:19:06.016260784Z [2024-02-23 01:19:06,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14404760-2378-4d75-9c04-0ceb503f71c2] succeeded in 4.820214385999861s: None 2024-02-23T01:20:01.193212296Z [2024-02-23 01:20:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53fedfef-2872-495c-bb4e-328fd722593f] received 2024-02-23T01:20:01.196894893Z [2024-02-23 01:20:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ff418f-3c0f-44fe-a01b-837c979b7f77] received 2024-02-23T01:20:01.199519645Z [2024-02-23 01:20:01,199: INFO/ForkPoolWorker-15] [53fedfef-2872-495c-bb4e-328fd722593f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:20:01.202441611Z [2024-02-23 01:20:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85c14e26-a9ca-4f17-a441-0a3dbe86ab41] received 2024-02-23T01:20:01.204292268Z [2024-02-23 01:20:01,204: INFO/ForkPoolWorker-16] [c5ff418f-3c0f-44fe-a01b-837c979b7f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:20:01.206542294Z [2024-02-23 01:20:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c08e6605-2ebd-4bd2-83f6-cc0ba41ad2fb] received 2024-02-23T01:20:01.217059914Z [2024-02-23 01:20:01,216: INFO/ForkPoolWorker-1] [85c14e26-a9ca-4f17-a441-0a3dbe86ab41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:20:01.217938512Z [2024-02-23 01:20:01,217: INFO/ForkPoolWorker-2] [c08e6605-2ebd-4bd2-83f6-cc0ba41ad2fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:20:01.230471341Z [2024-02-23 01:20:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4462ee98-7e76-4354-b105-4f287be601ea] received 2024-02-23T01:20:01.253477245Z [2024-02-23 01:20:01,252: INFO/ForkPoolWorker-3] [4462ee98-7e76-4354-b105-4f287be601ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:20:01.548602633Z [2024-02-23 01:20:01,545: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:20:01.616054624Z [2024-02-23 01:20:01,612: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:20:01.741278942Z [2024-02-23 01:20:01,740: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:20:01.750392749Z [2024-02-23 01:20:01,749: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:01.809027112Z [2024-02-23 01:20:01,808: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:20:01.811680769Z [2024-02-23 01:20:01,811: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:20:01.811878907Z [2024-02-23 01:20:01,811: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:20:01.812023987Z [2024-02-23 01:20:01,811: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:20:01.812332938Z [2024-02-23 01:20:01,812: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:20:01.854447258Z [2024-02-23 01:20:01,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:20:01.917006208Z [2024-02-23 01:20:01,916: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:02.013733689Z [2024-02-23 01:20:02,010: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:20:02.172135357Z [2024-02-23 01:20:02,158: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:20:02.579716079Z [2024-02-23 01:20:02,579: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:03.252882394Z [2024-02-23 01:20:03,252: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5ff418f-3c0f-44fe-a01b-837c979b7f77] succeeded in 2.054584233999776s: None 2024-02-23T01:20:03.573921561Z [2024-02-23 01:20:03,573: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4462ee98-7e76-4354-b105-4f287be601ea] succeeded in 2.339927039000031s: None 2024-02-23T01:20:03.639622710Z [2024-02-23 01:20:03,639: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:20:03.643517163Z [2024-02-23 01:20:03,643: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:03.666259677Z [2024-02-23 01:20:03,665: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:20:03.668322768Z [2024-02-23 01:20:03,668: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:20:03.668426514Z [2024-02-23 01:20:03,668: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:20:03.668653526Z [2024-02-23 01:20:03,668: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:20:03.668740714Z [2024-02-23 01:20:03,668: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:20:03.669107670Z [2024-02-23 01:20:03,668: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:20:03.669590612Z [2024-02-23 01:20:03,669: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:20:03.672134968Z [2024-02-23 01:20:03,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:20:03.676015805Z [2024-02-23 01:20:03,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:03.697005423Z [2024-02-23 01:20:03,696: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:20:03.700236898Z [2024-02-23 01:20:03,699: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:20:03.700458629Z [2024-02-23 01:20:03,700: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:20:03.700628186Z [2024-02-23 01:20:03,700: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:20:03.700685984Z [2024-02-23 01:20:03,700: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:20:03.701039275Z [2024-02-23 01:20:03,700: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:20:03.701140527Z [2024-02-23 01:20:03,701: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:20:03.754000272Z [2024-02-23 01:20:03,753: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:03.803458979Z [2024-02-23 01:20:03,803: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:04.005398180Z [2024-02-23 01:20:04,004: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:20:04.011419504Z [2024-02-23 01:20:04,010: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:04.047799248Z [2024-02-23 01:20:04,047: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:20:04.049728330Z [2024-02-23 01:20:04,049: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:20:04.049879878Z [2024-02-23 01:20:04,049: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:20:04.050099624Z [2024-02-23 01:20:04,049: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:20:04.050219435Z [2024-02-23 01:20:04,050: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:20:04.050540215Z [2024-02-23 01:20:04,050: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:20:04.050669108Z [2024-02-23 01:20:04,050: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:20:04.147680603Z [2024-02-23 01:20:04,147: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:04.487168874Z [2024-02-23 01:20:04,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c08e6605-2ebd-4bd2-83f6-cc0ba41ad2fb] succeeded in 3.278556173000652s: None 2024-02-23T01:20:04.991839276Z [2024-02-23 01:20:04,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d76c9d15-ebca-4d1b-8f52-a4cb474c60a6] received 2024-02-23T01:20:05.012212987Z [2024-02-23 01:20:05,011: INFO/ForkPoolWorker-16] [d76c9d15-ebca-4d1b-8f52-a4cb474c60a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:20:05.297684315Z [2024-02-23 01:20:05,294: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:20:05.793189142Z [2024-02-23 01:20:05,792: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[85c14e26-a9ca-4f17-a441-0a3dbe86ab41] succeeded in 4.582640472000094s: None 2024-02-23T01:20:06.027539636Z [2024-02-23 01:20:06,026: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53fedfef-2872-495c-bb4e-328fd722593f] succeeded in 4.832375762000083s: None 2024-02-23T01:20:06.519115428Z [2024-02-23 01:20:06,518: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:20:06.522603753Z [2024-02-23 01:20:06,522: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:06.549633460Z [2024-02-23 01:20:06,549: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:20:06.551308549Z [2024-02-23 01:20:06,551: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:20:06.551431740Z [2024-02-23 01:20:06,551: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:20:06.551621668Z [2024-02-23 01:20:06,551: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:20:06.551682709Z [2024-02-23 01:20:06,551: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:20:06.551968264Z [2024-02-23 01:20:06,551: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:20:06.552056395Z [2024-02-23 01:20:06,551: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:20:06.638247760Z [2024-02-23 01:20:06,637: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:07.262286847Z [2024-02-23 01:20:07,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d76c9d15-ebca-4d1b-8f52-a4cb474c60a6] succeeded in 2.26872873100001s: None 2024-02-23T01:20:07.479561166Z [2024-02-23 01:20:07,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5989f49c-7685-4380-bdbd-7372b6ec1bae] received 2024-02-23T01:20:07.491613934Z [2024-02-23 01:20:07,491: INFO/ForkPoolWorker-15] [5989f49c-7685-4380-bdbd-7372b6ec1bae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:20:07.776046133Z [2024-02-23 01:20:07,773: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:20:09.019919035Z [2024-02-23 01:20:09,019: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:20:09.023600291Z [2024-02-23 01:20:09,022: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:09.046091217Z [2024-02-23 01:20:09,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:20:09.048233015Z [2024-02-23 01:20:09,047: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:20:09.048560517Z [2024-02-23 01:20:09,048: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:20:09.051300563Z [2024-02-23 01:20:09,048: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:20:09.052030261Z [2024-02-23 01:20:09,051: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:20:09.053468384Z [2024-02-23 01:20:09,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:20:09.053747165Z [2024-02-23 01:20:09,053: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:20:09.168713246Z [2024-02-23 01:20:09,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:09.904762580Z [2024-02-23 01:20:09,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5989f49c-7685-4380-bdbd-7372b6ec1bae] succeeded in 2.4231571770005758s: None 2024-02-23T01:20:09.914611644Z [2024-02-23 01:20:09,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13774e6b-62e9-4baa-ba11-f2dee0fd5cef] received 2024-02-23T01:20:09.933898079Z [2024-02-23 01:20:09,933: INFO/ForkPoolWorker-15] [13774e6b-62e9-4baa-ba11-f2dee0fd5cef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:20:10.261393168Z [2024-02-23 01:20:10,258: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:20:11.309648766Z [2024-02-23 01:20:11,309: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:20:11.313029284Z [2024-02-23 01:20:11,312: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:20:11.338251733Z [2024-02-23 01:20:11,337: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:20:11.340488236Z [2024-02-23 01:20:11,340: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:20:11.340553080Z [2024-02-23 01:20:11,340: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:20:11.340757915Z [2024-02-23 01:20:11,340: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:20:11.340823521Z [2024-02-23 01:20:11,340: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:20:11.341172348Z [2024-02-23 01:20:11,341: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:20:11.341263327Z [2024-02-23 01:20:11,341: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:20:11.417713171Z [2024-02-23 01:20:11,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:20:11.988732035Z [2024-02-23 01:20:11,988: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13774e6b-62e9-4baa-ba11-f2dee0fd5cef] succeeded in 2.0724753780004903s: None 2024-02-23T01:21:00.851922655Z [2024-02-23 01:21:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03465f9b-ea83-488a-b99b-d2404f7a3ce8] received 2024-02-23T01:21:00.854999812Z [2024-02-23 01:21:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfbc0d5a-8c57-4e72-8fc0-12a9eb20817a] received 2024-02-23T01:21:00.862647317Z [2024-02-23 01:21:00,862: INFO/ForkPoolWorker-15] [03465f9b-ea83-488a-b99b-d2404f7a3ce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:21:00.866389551Z [2024-02-23 01:21:00,866: INFO/ForkPoolWorker-16] [dfbc0d5a-8c57-4e72-8fc0-12a9eb20817a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:21:00.867654655Z [2024-02-23 01:21:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47673619-9197-4b01-8025-ce5877aee9fe] received 2024-02-23T01:21:00.877764690Z [2024-02-23 01:21:00,877: INFO/ForkPoolWorker-1] [47673619-9197-4b01-8025-ce5877aee9fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:21:01.209290630Z [2024-02-23 01:21:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:21:01.210850711Z [2024-02-23 01:21:01,207: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:21:01.211935437Z [2024-02-23 01:21:01,208: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:21:01.365273263Z [2024-02-23 01:21:01,364: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:21:01.369434952Z [2024-02-23 01:21:01,368: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:21:01.396236959Z [2024-02-23 01:21:01,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:21:01.397862461Z [2024-02-23 01:21:01,397: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:21:01.400511161Z [2024-02-23 01:21:01,397: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:21:01.400704044Z [2024-02-23 01:21:01,400: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:21:01.401192721Z [2024-02-23 01:21:01,400: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:21:01.495522395Z [2024-02-23 01:21:01,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:21:02.151415614Z [2024-02-23 01:21:02,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03465f9b-ea83-488a-b99b-d2404f7a3ce8] succeeded in 1.2978300049999234s: None 2024-02-23T01:21:02.369876564Z [2024-02-23 01:21:02,369: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:21:02.373175473Z [2024-02-23 01:21:02,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:21:02.373779641Z [2024-02-23 01:21:02,373: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:21:02.377213832Z [2024-02-23 01:21:02,376: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:21:02.393135970Z [2024-02-23 01:21:02,392: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:21:02.394432000Z [2024-02-23 01:21:02,394: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:21:02.394500199Z [2024-02-23 01:21:02,394: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:21:02.394668548Z [2024-02-23 01:21:02,394: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:21:02.394984788Z [2024-02-23 01:21:02,394: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:21:02.395216219Z [2024-02-23 01:21:02,395: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:21:02.395316245Z [2024-02-23 01:21:02,395: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:21:02.399014056Z [2024-02-23 01:21:02,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:21:02.400106803Z [2024-02-23 01:21:02,399: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:21:02.400122678Z [2024-02-23 01:21:02,400: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:21:02.400214460Z [2024-02-23 01:21:02,400: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:21:02.400242431Z [2024-02-23 01:21:02,400: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:21:02.400476137Z [2024-02-23 01:21:02,400: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:21:02.400488254Z [2024-02-23 01:21:02,400: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:21:02.477955109Z [2024-02-23 01:21:02,477: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:21:02.479345470Z [2024-02-23 01:21:02,479: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:21:05.546652517Z [2024-02-23 01:21:05,545: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfbc0d5a-8c57-4e72-8fc0-12a9eb20817a] succeeded in 4.689145159999498s: None 2024-02-23T01:21:06.132382320Z [2024-02-23 01:21:06,131: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[47673619-9197-4b01-8025-ce5877aee9fe] succeeded in 5.262963379999746s: None 2024-02-23T01:22:01.115352374Z [2024-02-23 01:22:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bd06d19-389f-462e-bbe6-431a4c865aff] received 2024-02-23T01:22:01.122393675Z [2024-02-23 01:22:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9339717b-66fd-4e32-a4c9-954d09820da5] received 2024-02-23T01:22:01.130985490Z [2024-02-23 01:22:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2dc4a20-90d7-4df7-b521-8e9640bf107d] received 2024-02-23T01:22:01.142775145Z [2024-02-23 01:22:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8786c6c9-f3a2-4642-b6e3-29cdfcc5b776] received 2024-02-23T01:22:01.145172095Z [2024-02-23 01:22:01,144: INFO/ForkPoolWorker-15] [3bd06d19-389f-462e-bbe6-431a4c865aff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:22:01.151322453Z [2024-02-23 01:22:01,150: INFO/ForkPoolWorker-16] [9339717b-66fd-4e32-a4c9-954d09820da5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:22:01.151755254Z [2024-02-23 01:22:01,151: INFO/ForkPoolWorker-1] [b2dc4a20-90d7-4df7-b521-8e9640bf107d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:22:01.167258677Z [2024-02-23 01:22:01,166: INFO/ForkPoolWorker-2] [8786c6c9-f3a2-4642-b6e3-29cdfcc5b776] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:22:01.566479453Z [2024-02-23 01:22:01,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:22:01.605768734Z [2024-02-23 01:22:01,600: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:22:01.718705687Z [2024-02-23 01:22:01,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:22:01.726783443Z [2024-02-23 01:22:01,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:22:01.844964502Z [2024-02-23 01:22:01,844: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:22:01.859928199Z [2024-02-23 01:22:01,859: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:22:01.896687510Z [2024-02-23 01:22:01,896: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:22:01.898120372Z [2024-02-23 01:22:01,897: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:22:01.898444452Z [2024-02-23 01:22:01,898: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:22:01.898910197Z [2024-02-23 01:22:01,898: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:22:01.899089376Z [2024-02-23 01:22:01,898: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:22:02.033247278Z [2024-02-23 01:22:02,032: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:22:02.064109952Z [2024-02-23 01:22:02,063: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:22:02.773483107Z [2024-02-23 01:22:02,773: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3bd06d19-389f-462e-bbe6-431a4c865aff] succeeded in 1.6454319089998535s: None 2024-02-23T01:22:02.897279181Z [2024-02-23 01:22:02,896: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8786c6c9-f3a2-4642-b6e3-29cdfcc5b776] succeeded in 1.74982935800017s: None 2024-02-23T01:22:03.235990634Z [2024-02-23 01:22:03,235: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:22:03.239927679Z [2024-02-23 01:22:03,239: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:22:03.269001837Z [2024-02-23 01:22:03,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:22:03.270582580Z [2024-02-23 01:22:03,270: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:22:03.270798682Z [2024-02-23 01:22:03,270: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:22:03.271082021Z [2024-02-23 01:22:03,270: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:22:03.271243796Z [2024-02-23 01:22:03,271: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:22:03.271613874Z [2024-02-23 01:22:03,271: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:22:03.271790989Z [2024-02-23 01:22:03,271: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:22:03.272782004Z [2024-02-23 01:22:03,272: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:22:03.281233267Z [2024-02-23 01:22:03,280: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:22:03.335500289Z [2024-02-23 01:22:03,335: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:22:03.339024189Z [2024-02-23 01:22:03,338: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:22:03.339072592Z [2024-02-23 01:22:03,338: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:22:03.344437225Z [2024-02-23 01:22:03,338: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:22:03.344468769Z [2024-02-23 01:22:03,344: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:22:03.347153733Z [2024-02-23 01:22:03,346: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:22:03.347205692Z [2024-02-23 01:22:03,347: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:22:03.392780025Z [2024-02-23 01:22:03,392: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:22:03.482035347Z [2024-02-23 01:22:03,481: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:22:05.708343294Z [2024-02-23 01:22:05,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b2dc4a20-90d7-4df7-b521-8e9640bf107d] succeeded in 4.575156730999879s: None 2024-02-23T01:22:06.132082597Z [2024-02-23 01:22:06,131: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9339717b-66fd-4e32-a4c9-954d09820da5] succeeded in 5.0078312119994735s: None 2024-02-23T01:23:00.340257906Z [2024-02-23 01:23:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55a08555-a40a-4806-a5f8-278f27ca2c90] received 2024-02-23T01:23:00.346411267Z [2024-02-23 01:23:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df2bdef8-223a-4833-a720-cdcf4b61bd9e] received 2024-02-23T01:23:00.347990597Z [2024-02-23 01:23:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6c86dca-6da6-429f-abf2-9d42813711bf] received 2024-02-23T01:23:00.352895912Z [2024-02-23 01:23:00,352: INFO/ForkPoolWorker-15] [55a08555-a40a-4806-a5f8-278f27ca2c90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:23:00.355561292Z [2024-02-23 01:23:00,355: INFO/ForkPoolWorker-16] [df2bdef8-223a-4833-a720-cdcf4b61bd9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:23:00.357358945Z [2024-02-23 01:23:00,357: INFO/ForkPoolWorker-1] [e6c86dca-6da6-429f-abf2-9d42813711bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:23:00.680497241Z [2024-02-23 01:23:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:23:00.681797349Z [2024-02-23 01:23:00,678: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:23:00.686399987Z [2024-02-23 01:23:00,683: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:23:00.917906996Z [2024-02-23 01:23:00,917: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:23:00.922035869Z [2024-02-23 01:23:00,921: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:23:00.945582014Z [2024-02-23 01:23:00,945: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:23:00.946727026Z [2024-02-23 01:23:00,946: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:23:00.947041379Z [2024-02-23 01:23:00,946: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:23:00.947231751Z [2024-02-23 01:23:00,947: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:23:00.947671098Z [2024-02-23 01:23:00,947: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:23:01.048541207Z [2024-02-23 01:23:01,048: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:23:01.688022930Z [2024-02-23 01:23:01,687: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55a08555-a40a-4806-a5f8-278f27ca2c90] succeeded in 1.3443704090004758s: None 2024-02-23T01:23:01.919908119Z [2024-02-23 01:23:01,919: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:23:01.923891263Z [2024-02-23 01:23:01,923: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:23:01.942935370Z [2024-02-23 01:23:01,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:23:01.944357642Z [2024-02-23 01:23:01,944: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:23:01.944525415Z [2024-02-23 01:23:01,944: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:23:01.944762327Z [2024-02-23 01:23:01,944: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:23:01.944895772Z [2024-02-23 01:23:01,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:23:01.945208451Z [2024-02-23 01:23:01,945: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:23:01.945705091Z [2024-02-23 01:23:01,945: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:23:01.996158018Z [2024-02-23 01:23:01,995: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:23:02.004580128Z [2024-02-23 01:23:02,000: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:23:02.023547244Z [2024-02-23 01:23:02,023: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:23:02.024866661Z [2024-02-23 01:23:02,024: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:23:02.025028563Z [2024-02-23 01:23:02,024: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:23:02.025234779Z [2024-02-23 01:23:02,024: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:23:02.025400596Z [2024-02-23 01:23:02,025: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:23:02.025691942Z [2024-02-23 01:23:02,025: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:23:02.026179167Z [2024-02-23 01:23:02,026: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:23:02.033106867Z [2024-02-23 01:23:02,032: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:23:02.124027803Z [2024-02-23 01:23:02,123: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:23:03.570384272Z [2024-02-23 01:23:03,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df2bdef8-223a-4833-a720-cdcf4b61bd9e] succeeded in 3.222439170999678s: None 2024-02-23T01:23:03.896408354Z [2024-02-23 01:23:03,895: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6c86dca-6da6-429f-abf2-9d42813711bf] succeeded in 3.546199694999814s: None 2024-02-23T01:24:00.582001166Z [2024-02-23 01:24:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11572d30-173f-47ec-8c7d-51374a8c741e] received 2024-02-23T01:24:00.585467242Z [2024-02-23 01:24:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9be7c758-31ff-4f40-9d5e-b3f5480fbcda] received 2024-02-23T01:24:00.600583888Z [2024-02-23 01:24:00,600: INFO/ForkPoolWorker-16] [9be7c758-31ff-4f40-9d5e-b3f5480fbcda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:24:00.606130337Z [2024-02-23 01:24:00,605: INFO/ForkPoolWorker-15] [11572d30-173f-47ec-8c7d-51374a8c741e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:24:00.608144926Z [2024-02-23 01:24:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca1c86fc-70b5-4624-b328-32e4d92d76b1] received 2024-02-23T01:24:00.616750954Z [2024-02-23 01:24:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0326c909-6bf9-4204-853d-d27334817554] received 2024-02-23T01:24:00.619386176Z [2024-02-23 01:24:00,617: INFO/ForkPoolWorker-1] [ca1c86fc-70b5-4624-b328-32e4d92d76b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:24:00.623589112Z [2024-02-23 01:24:00,623: INFO/ForkPoolWorker-2] [0326c909-6bf9-4204-853d-d27334817554] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:24:00.941285415Z [2024-02-23 01:24:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:24:00.954482981Z [2024-02-23 01:24:00,951: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:24:01.077248483Z [2024-02-23 01:24:01,074: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:24:01.202246028Z [2024-02-23 01:24:01,198: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:24:01.207397707Z [2024-02-23 01:24:01,207: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:24:01.454796574Z [2024-02-23 01:24:01,454: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:24:01.459237759Z [2024-02-23 01:24:01,458: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:24:01.498411399Z [2024-02-23 01:24:01,498: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:24:01.499918784Z [2024-02-23 01:24:01,499: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:24:01.500108086Z [2024-02-23 01:24:01,499: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:24:01.500155953Z [2024-02-23 01:24:01,500: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:24:01.500659968Z [2024-02-23 01:24:01,500: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:24:01.650247641Z [2024-02-23 01:24:01,649: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:24:01.822809672Z [2024-02-23 01:24:01,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11572d30-173f-47ec-8c7d-51374a8c741e] succeeded in 1.2346513110005617s: None 2024-02-23T01:24:02.381979929Z [2024-02-23 01:24:02,381: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:24:02.385547415Z [2024-02-23 01:24:02,384: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:24:02.408405941Z [2024-02-23 01:24:02,407: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:24:02.410951894Z [2024-02-23 01:24:02,410: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:24:02.411117261Z [2024-02-23 01:24:02,410: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:24:02.411366211Z [2024-02-23 01:24:02,411: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:24:02.411479518Z [2024-02-23 01:24:02,411: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:24:02.411819690Z [2024-02-23 01:24:02,411: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:24:02.411887914Z [2024-02-23 01:24:02,411: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:24:02.439656720Z [2024-02-23 01:24:02,439: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca1c86fc-70b5-4624-b328-32e4d92d76b1] succeeded in 1.8272760609997931s: None 2024-02-23T01:24:02.470433645Z [2024-02-23 01:24:02,469: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:24:02.473713141Z [2024-02-23 01:24:02,473: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:24:02.500862592Z [2024-02-23 01:24:02,500: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:24:02.502573783Z [2024-02-23 01:24:02,502: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:24:02.502595400Z [2024-02-23 01:24:02,502: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:24:02.502818843Z [2024-02-23 01:24:02,502: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:24:02.502930552Z [2024-02-23 01:24:02,502: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:24:02.503218098Z [2024-02-23 01:24:02,503: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:24:02.503370148Z [2024-02-23 01:24:02,503: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:24:02.529158775Z [2024-02-23 01:24:02,528: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:24:02.610461510Z [2024-02-23 01:24:02,610: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:24:04.687937940Z [2024-02-23 01:24:04,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9be7c758-31ff-4f40-9d5e-b3f5480fbcda] succeeded in 4.095046946000366s: None 2024-02-23T01:24:05.188316171Z [2024-02-23 01:24:05,187: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0326c909-6bf9-4204-853d-d27334817554] succeeded in 4.570020398999986s: None 2024-02-23T01:25:00.390977769Z [2024-02-23 01:25:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96ac6337-c2d0-45c2-83bc-f4b5f2316a32] received 2024-02-23T01:25:00.399783056Z [2024-02-23 01:25:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31bbe767-665d-43ff-920b-3c56fc6c7d34] received 2024-02-23T01:25:00.401814154Z [2024-02-23 01:25:00,401: INFO/ForkPoolWorker-15] [96ac6337-c2d0-45c2-83bc-f4b5f2316a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:25:00.404855537Z [2024-02-23 01:25:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40dcee04-46d6-4466-8cd0-7b9fa1e024f7] received 2024-02-23T01:25:00.411330317Z [2024-02-23 01:25:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b57e0b4-e650-4661-b1f2-c374270dcf4c] received 2024-02-23T01:25:00.413081310Z [2024-02-23 01:25:00,412: INFO/ForkPoolWorker-16] [31bbe767-665d-43ff-920b-3c56fc6c7d34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:25:00.416026372Z [2024-02-23 01:25:00,415: INFO/ForkPoolWorker-1] [40dcee04-46d6-4466-8cd0-7b9fa1e024f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:25:00.427385181Z [2024-02-23 01:25:00,427: INFO/ForkPoolWorker-2] [5b57e0b4-e650-4661-b1f2-c374270dcf4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:25:00.732044868Z [2024-02-23 01:25:00,728: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:25:00.735012954Z [2024-02-23 01:25:00,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:25:00.859079326Z [2024-02-23 01:25:00,856: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:25:00.869991789Z [2024-02-23 01:25:00,866: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:25:01.064157756Z [2024-02-23 01:25:01,063: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:25:01.068395344Z [2024-02-23 01:25:01,067: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:01.115948314Z [2024-02-23 01:25:01,115: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:25:01.117400313Z [2024-02-23 01:25:01,117: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:25:01.117640916Z [2024-02-23 01:25:01,117: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:25:01.117816001Z [2024-02-23 01:25:01,117: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:25:01.118181916Z [2024-02-23 01:25:01,117: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:25:01.203391263Z [2024-02-23 01:25:01,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:01.833493223Z [2024-02-23 01:25:01,832: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[40dcee04-46d6-4466-8cd0-7b9fa1e024f7] succeeded in 1.4240335599997707s: None 2024-02-23T01:25:02.100060247Z [2024-02-23 01:25:02,099: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:25:02.105248343Z [2024-02-23 01:25:02,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:02.111688754Z [2024-02-23 01:25:02,111: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:25:02.116012411Z [2024-02-23 01:25:02,115: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:02.129268227Z [2024-02-23 01:25:02,128: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:25:02.130958962Z [2024-02-23 01:25:02,130: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:25:02.131230612Z [2024-02-23 01:25:02,131: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:25:02.131728227Z [2024-02-23 01:25:02,131: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:25:02.131912176Z [2024-02-23 01:25:02,131: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:25:02.132338526Z [2024-02-23 01:25:02,132: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:25:02.132474140Z [2024-02-23 01:25:02,132: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:25:02.146138576Z [2024-02-23 01:25:02,145: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:25:02.147727021Z [2024-02-23 01:25:02,147: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:25:02.147770860Z [2024-02-23 01:25:02,147: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:25:02.147952196Z [2024-02-23 01:25:02,147: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:25:02.147999177Z [2024-02-23 01:25:02,147: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:25:02.148292549Z [2024-02-23 01:25:02,148: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:25:02.148359599Z [2024-02-23 01:25:02,148: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:25:02.151380043Z [2024-02-23 01:25:02,150: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:25:02.154909020Z [2024-02-23 01:25:02,154: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:02.177573429Z [2024-02-23 01:25:02,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:25:02.180799578Z [2024-02-23 01:25:02,180: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:25:02.180921680Z [2024-02-23 01:25:02,180: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:25:02.181101342Z [2024-02-23 01:25:02,180: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:25:02.181226255Z [2024-02-23 01:25:02,181: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:25:02.181789729Z [2024-02-23 01:25:02,181: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:25:02.181931040Z [2024-02-23 01:25:02,181: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:25:02.212388459Z [2024-02-23 01:25:02,212: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:02.263996212Z [2024-02-23 01:25:02,263: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:02.281212614Z [2024-02-23 01:25:02,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:02.977028779Z [2024-02-23 01:25:02,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96ac6337-c2d0-45c2-83bc-f4b5f2316a32] succeeded in 2.5822607959999004s: None 2024-02-23T01:25:03.123961264Z [2024-02-23 01:25:03,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12e6c581-158b-4850-8e05-2448191b28f0] received 2024-02-23T01:25:03.135924310Z [2024-02-23 01:25:03,135: INFO/ForkPoolWorker-15] [12e6c581-158b-4850-8e05-2448191b28f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:25:03.424248903Z [2024-02-23 01:25:03,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:25:03.841273443Z [2024-02-23 01:25:03,840: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31bbe767-665d-43ff-920b-3c56fc6c7d34] succeeded in 3.4370977600001424s: None 2024-02-23T01:25:04.076734339Z [2024-02-23 01:25:04,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5b57e0b4-e650-4661-b1f2-c374270dcf4c] succeeded in 3.6615304979995926s: None 2024-02-23T01:25:04.659419927Z [2024-02-23 01:25:04,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:25:04.663378309Z [2024-02-23 01:25:04,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:04.684187453Z [2024-02-23 01:25:04,683: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:25:04.686107734Z [2024-02-23 01:25:04,685: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:25:04.686424604Z [2024-02-23 01:25:04,686: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:25:04.686802176Z [2024-02-23 01:25:04,686: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:25:04.687107411Z [2024-02-23 01:25:04,686: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:25:04.687560242Z [2024-02-23 01:25:04,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:25:04.688180500Z [2024-02-23 01:25:04,687: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:25:04.869091739Z [2024-02-23 01:25:04,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:05.616551361Z [2024-02-23 01:25:05,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12e6c581-158b-4850-8e05-2448191b28f0] succeeded in 2.4905449170000793s: None 2024-02-23T01:25:05.824564116Z [2024-02-23 01:25:05,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aaa9429-466c-4b91-a257-a1ea1db98ee7] received 2024-02-23T01:25:05.838081783Z [2024-02-23 01:25:05,837: INFO/ForkPoolWorker-15] [7aaa9429-466c-4b91-a257-a1ea1db98ee7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:25:06.119309873Z [2024-02-23 01:25:06,115: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:25:07.247295262Z [2024-02-23 01:25:07,246: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:25:07.250793343Z [2024-02-23 01:25:07,250: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:07.274137889Z [2024-02-23 01:25:07,273: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:25:07.275831361Z [2024-02-23 01:25:07,275: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:25:07.276104518Z [2024-02-23 01:25:07,275: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:25:07.276423306Z [2024-02-23 01:25:07,276: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:25:07.276687690Z [2024-02-23 01:25:07,276: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:25:07.277104133Z [2024-02-23 01:25:07,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:25:07.277355335Z [2024-02-23 01:25:07,277: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:25:07.392007876Z [2024-02-23 01:25:07,391: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:07.977446939Z [2024-02-23 01:25:07,977: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7aaa9429-466c-4b91-a257-a1ea1db98ee7] succeeded in 2.1478288909993353s: None 2024-02-23T01:25:08.230358697Z [2024-02-23 01:25:08,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97275ef2-8148-4fe5-b94e-d2e40e37d9e2] received 2024-02-23T01:25:08.263640580Z [2024-02-23 01:25:08,263: INFO/ForkPoolWorker-15] [97275ef2-8148-4fe5-b94e-d2e40e37d9e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:25:08.555978382Z [2024-02-23 01:25:08,552: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:25:09.671111091Z [2024-02-23 01:25:09,670: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:25:09.674428359Z [2024-02-23 01:25:09,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:25:09.703854149Z [2024-02-23 01:25:09,703: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:25:09.705349661Z [2024-02-23 01:25:09,705: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:25:09.705489385Z [2024-02-23 01:25:09,705: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:25:09.705673436Z [2024-02-23 01:25:09,705: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:25:09.705782193Z [2024-02-23 01:25:09,705: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:25:09.706089138Z [2024-02-23 01:25:09,705: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:25:09.706154854Z [2024-02-23 01:25:09,706: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:25:09.782190106Z [2024-02-23 01:25:09,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:25:10.419566896Z [2024-02-23 01:25:10,418: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97275ef2-8148-4fe5-b94e-d2e40e37d9e2] succeeded in 2.1873559740006385s: None 2024-02-23T01:26:01.175631857Z [2024-02-23 01:26:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be145f8-553d-468e-bd4e-e9fc63ccbd1b] received 2024-02-23T01:26:01.180175016Z [2024-02-23 01:26:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b7ca0f8-ab16-4659-9ca2-74d609bd0bd4] received 2024-02-23T01:26:01.183431332Z [2024-02-23 01:26:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[980efe17-7080-4990-85c7-7e761614ff93] received 2024-02-23T01:26:01.190669560Z [2024-02-23 01:26:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0efe4444-ea8c-4fa2-b45e-e7a9cd5766e3] received 2024-02-23T01:26:01.191525567Z [2024-02-23 01:26:01,191: INFO/ForkPoolWorker-1] [980efe17-7080-4990-85c7-7e761614ff93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:26:01.199595928Z [2024-02-23 01:26:01,199: INFO/ForkPoolWorker-16] [0b7ca0f8-ab16-4659-9ca2-74d609bd0bd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:26:01.201294259Z [2024-02-23 01:26:01,200: INFO/ForkPoolWorker-15] [5be145f8-553d-468e-bd4e-e9fc63ccbd1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:26:01.203447396Z [2024-02-23 01:26:01,203: INFO/ForkPoolWorker-2] [0efe4444-ea8c-4fa2-b45e-e7a9cd5766e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:26:01.553854158Z [2024-02-23 01:26:01,550: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:26:01.562448147Z [2024-02-23 01:26:01,559: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:26:01.620679256Z [2024-02-23 01:26:01,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:26:01.642101761Z [2024-02-23 01:26:01,638: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:26:01.867371317Z [2024-02-23 01:26:01,866: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:26:01.872510648Z [2024-02-23 01:26:01,872: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:26:01.913271566Z [2024-02-23 01:26:01,912: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:26:01.926219279Z [2024-02-23 01:26:01,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:26:01.928593637Z [2024-02-23 01:26:01,928: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:26:01.928694720Z [2024-02-23 01:26:01,928: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:26:01.928772247Z [2024-02-23 01:26:01,928: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:26:01.929004153Z [2024-02-23 01:26:01,928: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:26:02.056534221Z [2024-02-23 01:26:02,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:26:02.495342430Z [2024-02-23 01:26:02,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5be145f8-553d-468e-bd4e-e9fc63ccbd1b] succeeded in 1.3173435369999424s: None 2024-02-23T01:26:02.757835994Z [2024-02-23 01:26:02,757: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b7ca0f8-ab16-4659-9ca2-74d609bd0bd4] succeeded in 1.5746281809997527s: None 2024-02-23T01:26:03.056868417Z [2024-02-23 01:26:03,056: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:26:03.060185271Z [2024-02-23 01:26:03,059: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:26:03.099293378Z [2024-02-23 01:26:03,099: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:26:03.104537284Z [2024-02-23 01:26:03,104: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:26:03.104686547Z [2024-02-23 01:26:03,104: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:26:03.104949275Z [2024-02-23 01:26:03,104: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:26:03.105095803Z [2024-02-23 01:26:03,104: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:26:03.105658113Z [2024-02-23 01:26:03,105: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:26:03.105807433Z [2024-02-23 01:26:03,105: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:26:03.139980976Z [2024-02-23 01:26:03,139: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:26:03.143391583Z [2024-02-23 01:26:03,142: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:26:03.176739766Z [2024-02-23 01:26:03,176: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:26:03.178806851Z [2024-02-23 01:26:03,178: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:26:03.179139884Z [2024-02-23 01:26:03,178: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:26:03.179502483Z [2024-02-23 01:26:03,179: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:26:03.179564704Z [2024-02-23 01:26:03,179: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:26:03.180057122Z [2024-02-23 01:26:03,179: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:26:03.180259773Z [2024-02-23 01:26:03,179: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:26:03.222396639Z [2024-02-23 01:26:03,222: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:26:03.267176699Z [2024-02-23 01:26:03,266: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:26:05.077195352Z [2024-02-23 01:26:05,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0efe4444-ea8c-4fa2-b45e-e7a9cd5766e3] succeeded in 3.880638865000037s: None 2024-02-23T01:26:05.785891729Z [2024-02-23 01:26:05,785: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[980efe17-7080-4990-85c7-7e761614ff93] succeeded in 4.600585658999989s: None 2024-02-23T01:27:00.312542477Z [2024-02-23 01:27:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc99f3bb-fdd6-4a11-be5b-f116c14bc6de] received 2024-02-23T01:27:00.320018333Z [2024-02-23 01:27:00,319: INFO/ForkPoolWorker-15] [fc99f3bb-fdd6-4a11-be5b-f116c14bc6de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:27:00.327964485Z [2024-02-23 01:27:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8347589a-2e00-41ad-929f-5d6876f4776d] received 2024-02-23T01:27:00.339368752Z [2024-02-23 01:27:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26e02150-6e69-47bf-8d76-c5fc6849a635] received 2024-02-23T01:27:00.344816685Z [2024-02-23 01:27:00,344: INFO/ForkPoolWorker-16] [8347589a-2e00-41ad-929f-5d6876f4776d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:27:00.349525809Z [2024-02-23 01:27:00,349: INFO/ForkPoolWorker-1] [26e02150-6e69-47bf-8d76-c5fc6849a635] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:27:00.691715650Z [2024-02-23 01:27:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:27:00.727493737Z [2024-02-23 01:27:00,724: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:27:00.827910964Z [2024-02-23 01:27:00,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:27:00.863788997Z [2024-02-23 01:27:00,863: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:27:00.867702315Z [2024-02-23 01:27:00,867: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:27:00.892703376Z [2024-02-23 01:27:00,892: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:27:00.894064820Z [2024-02-23 01:27:00,893: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:27:00.894251347Z [2024-02-23 01:27:00,894: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:27:00.894382800Z [2024-02-23 01:27:00,894: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:27:00.894670256Z [2024-02-23 01:27:00,894: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:27:01.059637816Z [2024-02-23 01:27:01,059: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:27:01.700376923Z [2024-02-23 01:27:01,700: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8347589a-2e00-41ad-929f-5d6876f4776d] succeeded in 1.3662269850001394s: None 2024-02-23T01:27:02.045579924Z [2024-02-23 01:27:02,045: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:27:02.048839920Z [2024-02-23 01:27:02,048: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:27:02.073540743Z [2024-02-23 01:27:02,073: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:27:02.075556081Z [2024-02-23 01:27:02,075: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:27:02.075810307Z [2024-02-23 01:27:02,075: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:27:02.076077030Z [2024-02-23 01:27:02,075: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:27:02.076235845Z [2024-02-23 01:27:02,076: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:27:02.076536130Z [2024-02-23 01:27:02,076: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:27:02.076949356Z [2024-02-23 01:27:02,076: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:27:02.103960550Z [2024-02-23 01:27:02,103: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:27:02.107559180Z [2024-02-23 01:27:02,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:27:02.133256238Z [2024-02-23 01:27:02,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:27:02.136214113Z [2024-02-23 01:27:02,135: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:27:02.136243943Z [2024-02-23 01:27:02,136: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:27:02.136421754Z [2024-02-23 01:27:02,136: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:27:02.136441468Z [2024-02-23 01:27:02,136: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:27:02.136673001Z [2024-02-23 01:27:02,136: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:27:02.136689824Z [2024-02-23 01:27:02,136: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:27:02.187986810Z [2024-02-23 01:27:02,187: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:27:02.225437073Z [2024-02-23 01:27:02,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:27:03.827075096Z [2024-02-23 01:27:03,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc99f3bb-fdd6-4a11-be5b-f116c14bc6de] succeeded in 3.511754321000808s: None 2024-02-23T01:27:04.721472776Z [2024-02-23 01:27:04,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26e02150-6e69-47bf-8d76-c5fc6849a635] succeeded in 4.378050524000173s: None 2024-02-23T01:28:01.061896881Z [2024-02-23 01:28:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bf44d7a-1746-4ab6-8959-335cd0328198] received 2024-02-23T01:28:01.064099472Z [2024-02-23 01:28:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc4d0c45-6334-4b2b-a914-c738305eb9f2] received 2024-02-23T01:28:01.072536787Z [2024-02-23 01:28:01,072: INFO/ForkPoolWorker-16] [fc4d0c45-6334-4b2b-a914-c738305eb9f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:28:01.073704035Z [2024-02-23 01:28:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[781a67d0-92f7-4186-8586-78af533f206f] received 2024-02-23T01:28:01.084075570Z [2024-02-23 01:28:01,083: INFO/ForkPoolWorker-1] [781a67d0-92f7-4186-8586-78af533f206f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:28:01.084509091Z [2024-02-23 01:28:01,084: INFO/ForkPoolWorker-15] [1bf44d7a-1746-4ab6-8959-335cd0328198] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:28:01.091119561Z [2024-02-23 01:28:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9429ddeb-1277-4021-a37f-6947e6d17e3c] received 2024-02-23T01:28:01.099388499Z [2024-02-23 01:28:01,099: INFO/ForkPoolWorker-2] [9429ddeb-1277-4021-a37f-6947e6d17e3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:28:01.364017065Z [2024-02-23 01:28:01,360: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:28:01.394913469Z [2024-02-23 01:28:01,391: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:28:01.439550602Z [2024-02-23 01:28:01,436: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:28:01.525556032Z [2024-02-23 01:28:01,520: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:28:01.562058845Z [2024-02-23 01:28:01,561: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:28:01.567216467Z [2024-02-23 01:28:01,566: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:28:01.591463675Z [2024-02-23 01:28:01,591: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:28:01.592698778Z [2024-02-23 01:28:01,592: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:28:01.592837342Z [2024-02-23 01:28:01,592: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:28:01.592877990Z [2024-02-23 01:28:01,592: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:28:01.593088684Z [2024-02-23 01:28:01,592: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:28:01.653547671Z [2024-02-23 01:28:01,653: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:28:01.692435631Z [2024-02-23 01:28:01,692: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:28:02.251978576Z [2024-02-23 01:28:02,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bf44d7a-1746-4ab6-8959-335cd0328198] succeeded in 1.1853281610001432s: None 2024-02-23T01:28:02.318599748Z [2024-02-23 01:28:02,318: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9429ddeb-1277-4021-a37f-6947e6d17e3c] succeeded in 1.2247963509998954s: None 2024-02-23T01:28:02.869166439Z [2024-02-23 01:28:02,868: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:28:02.885169443Z [2024-02-23 01:28:02,884: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:28:02.907669006Z [2024-02-23 01:28:02,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:28:02.909057971Z [2024-02-23 01:28:02,908: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:28:02.909072029Z [2024-02-23 01:28:02,908: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:28:02.909106697Z [2024-02-23 01:28:02,908: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:28:02.909111632Z [2024-02-23 01:28:02,909: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:28:02.909382769Z [2024-02-23 01:28:02,909: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:28:02.909407849Z [2024-02-23 01:28:02,909: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:28:03.007926164Z [2024-02-23 01:28:03,007: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:28:03.011128743Z [2024-02-23 01:28:03,010: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:28:03.025163583Z [2024-02-23 01:28:03,024: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:28:03.048252984Z [2024-02-23 01:28:03,048: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:28:03.049645580Z [2024-02-23 01:28:03,049: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:28:03.049721899Z [2024-02-23 01:28:03,049: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:28:03.049899090Z [2024-02-23 01:28:03,049: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:28:03.049963850Z [2024-02-23 01:28:03,049: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:28:03.050330724Z [2024-02-23 01:28:03,050: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:28:03.050342615Z [2024-02-23 01:28:03,050: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:28:03.136009078Z [2024-02-23 01:28:03,135: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:28:04.815059620Z [2024-02-23 01:28:04,813: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[781a67d0-92f7-4186-8586-78af533f206f] succeeded in 3.7375444139997853s: None 2024-02-23T01:28:05.068309753Z [2024-02-23 01:28:05,067: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc4d0c45-6334-4b2b-a914-c738305eb9f2] succeeded in 4.002957461999358s: None 2024-02-23T01:29:00.899777955Z [2024-02-23 01:29:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13d7ea6e-6c1f-48d1-aa47-237e86da4f03] received 2024-02-23T01:29:00.904578230Z [2024-02-23 01:29:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf149da9-aeb0-4b17-8339-335dde560a1f] received 2024-02-23T01:29:00.906762600Z [2024-02-23 01:29:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c11f5bd-a174-45fe-a758-358882c4f2c3] received 2024-02-23T01:29:00.914378753Z [2024-02-23 01:29:00,912: INFO/ForkPoolWorker-15] [13d7ea6e-6c1f-48d1-aa47-237e86da4f03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:29:00.918305635Z [2024-02-23 01:29:00,917: INFO/ForkPoolWorker-1] [9c11f5bd-a174-45fe-a758-358882c4f2c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:29:00.918924708Z [2024-02-23 01:29:00,918: INFO/ForkPoolWorker-16] [cf149da9-aeb0-4b17-8339-335dde560a1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:29:01.219482496Z [2024-02-23 01:29:01,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:29:01.255458057Z [2024-02-23 01:29:01,247: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:29:01.397094510Z [2024-02-23 01:29:01,394: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:29:01.466864427Z [2024-02-23 01:29:01,466: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:29:01.474423127Z [2024-02-23 01:29:01,473: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:29:01.503128928Z [2024-02-23 01:29:01,502: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:29:01.504459981Z [2024-02-23 01:29:01,504: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:29:01.504683771Z [2024-02-23 01:29:01,504: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:29:01.504791795Z [2024-02-23 01:29:01,504: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:29:01.505154199Z [2024-02-23 01:29:01,504: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:29:01.648838455Z [2024-02-23 01:29:01,648: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:29:02.368205378Z [2024-02-23 01:29:02,367: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c11f5bd-a174-45fe-a758-358882c4f2c3] succeeded in 1.4598477320005259s: None 2024-02-23T01:29:02.519804170Z [2024-02-23 01:29:02,519: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:29:02.523561446Z [2024-02-23 01:29:02,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:29:02.543215473Z [2024-02-23 01:29:02,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:29:02.544589036Z [2024-02-23 01:29:02,544: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:29:02.544741287Z [2024-02-23 01:29:02,544: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:29:02.544903634Z [2024-02-23 01:29:02,544: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:29:02.544994940Z [2024-02-23 01:29:02,544: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:29:02.545243436Z [2024-02-23 01:29:02,545: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:29:02.545379332Z [2024-02-23 01:29:02,545: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:29:02.584276645Z [2024-02-23 01:29:02,583: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:29:02.588011869Z [2024-02-23 01:29:02,587: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:29:02.609499638Z [2024-02-23 01:29:02,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:29:02.610896627Z [2024-02-23 01:29:02,610: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:29:02.610919340Z [2024-02-23 01:29:02,610: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:29:02.611054404Z [2024-02-23 01:29:02,610: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:29:02.611095321Z [2024-02-23 01:29:02,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:29:02.611544085Z [2024-02-23 01:29:02,611: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:29:02.611565258Z [2024-02-23 01:29:02,611: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:29:02.622896544Z [2024-02-23 01:29:02,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:29:02.705385225Z [2024-02-23 01:29:02,705: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:29:04.939973551Z [2024-02-23 01:29:04,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13d7ea6e-6c1f-48d1-aa47-237e86da4f03] succeeded in 4.037435721999827s: None 2024-02-23T01:29:05.113988685Z [2024-02-23 01:29:05,113: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf149da9-aeb0-4b17-8339-335dde560a1f] succeeded in 4.205712532000689s: None 2024-02-23T01:30:00.881681476Z [2024-02-23 01:30:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37d0bbf7-ea3e-4ba5-8e0d-66336979d5dd] received 2024-02-23T01:30:00.889447002Z [2024-02-23 01:30:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce5e77a0-5af8-4fda-bc17-ea6c70b78a63] received 2024-02-23T01:30:00.891064355Z [2024-02-23 01:30:00,890: INFO/ForkPoolWorker-15] [37d0bbf7-ea3e-4ba5-8e0d-66336979d5dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:30:00.896521011Z [2024-02-23 01:30:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d13660e2-32e1-4015-9829-158fc0e1d803] received 2024-02-23T01:30:00.898474225Z [2024-02-23 01:30:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[856b33da-6a49-4d92-b1cc-bc1fb4fe87ef] received 2024-02-23T01:30:00.901405312Z [2024-02-23 01:30:00,901: INFO/ForkPoolWorker-16] [ce5e77a0-5af8-4fda-bc17-ea6c70b78a63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:30:00.906373978Z [2024-02-23 01:30:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64e7c7f1-9ef7-45da-abdc-d5cdae4b3e7b] received 2024-02-23T01:30:00.907925352Z [2024-02-23 01:30:00,907: INFO/ForkPoolWorker-1] [d13660e2-32e1-4015-9829-158fc0e1d803] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:30:00.916806900Z [2024-02-23 01:30:00,916: INFO/ForkPoolWorker-2] [856b33da-6a49-4d92-b1cc-bc1fb4fe87ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:30:00.918714479Z [2024-02-23 01:30:00,918: INFO/ForkPoolWorker-3] [64e7c7f1-9ef7-45da-abdc-d5cdae4b3e7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:30:01.238165989Z [2024-02-23 01:30:01,235: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:30:01.246241091Z [2024-02-23 01:30:01,241: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:30:01.415698755Z [2024-02-23 01:30:01,412: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:30:01.495978058Z [2024-02-23 01:30:01,488: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:30:01.500106861Z [2024-02-23 01:30:01,496: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:30:01.725238084Z [2024-02-23 01:30:01,724: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:30:01.733846762Z [2024-02-23 01:30:01,733: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:01.779681680Z [2024-02-23 01:30:01,779: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:30:01.782051149Z [2024-02-23 01:30:01,781: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:30:01.782216050Z [2024-02-23 01:30:01,782: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:30:01.782419656Z [2024-02-23 01:30:01,782: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:30:01.783331068Z [2024-02-23 01:30:01,783: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:30:01.931564607Z [2024-02-23 01:30:01,931: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:01.948886151Z [2024-02-23 01:30:01,948: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:02.663686757Z [2024-02-23 01:30:02,663: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d13660e2-32e1-4015-9829-158fc0e1d803] succeeded in 1.7638566300001912s: None 2024-02-23T01:30:02.775425660Z [2024-02-23 01:30:02,774: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[856b33da-6a49-4d92-b1cc-bc1fb4fe87ef] succeeded in 1.870975179999732s: None 2024-02-23T01:30:02.915327917Z [2024-02-23 01:30:02,914: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:30:02.919231589Z [2024-02-23 01:30:02,918: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:02.928932290Z [2024-02-23 01:30:02,928: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:30:02.932818467Z [2024-02-23 01:30:02,932: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:02.938294084Z [2024-02-23 01:30:02,938: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:30:02.939851476Z [2024-02-23 01:30:02,939: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:30:02.939928281Z [2024-02-23 01:30:02,939: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:30:02.940071718Z [2024-02-23 01:30:02,939: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:30:02.940219785Z [2024-02-23 01:30:02,940: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:30:02.940520595Z [2024-02-23 01:30:02,940: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:30:02.940573443Z [2024-02-23 01:30:02,940: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:30:02.973505501Z [2024-02-23 01:30:02,973: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:30:02.975333510Z [2024-02-23 01:30:02,975: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:30:02.975692784Z [2024-02-23 01:30:02,975: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:30:02.975936116Z [2024-02-23 01:30:02,975: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:30:02.976113741Z [2024-02-23 01:30:02,975: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:30:02.976473765Z [2024-02-23 01:30:02,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:30:02.976693809Z [2024-02-23 01:30:02,976: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:30:03.023517119Z [2024-02-23 01:30:03,023: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T01:30:03.026785387Z [2024-02-23 01:30:03,026: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:03.036071084Z [2024-02-23 01:30:03,035: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:03.056837019Z [2024-02-23 01:30:03,056: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:30:03.058631949Z [2024-02-23 01:30:03,058: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:30:03.058780745Z [2024-02-23 01:30:03,058: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:30:03.059055533Z [2024-02-23 01:30:03,058: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:30:03.059213757Z [2024-02-23 01:30:03,059: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T01:30:03.059558123Z [2024-02-23 01:30:03,059: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:30:03.059623653Z [2024-02-23 01:30:03,059: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:30:03.072277303Z [2024-02-23 01:30:03,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:03.161746919Z [2024-02-23 01:30:03,161: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:03.729509819Z [2024-02-23 01:30:03,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37d0bbf7-ea3e-4ba5-8e0d-66336979d5dd] succeeded in 2.845881668000402s: None 2024-02-23T01:30:04.668834204Z [2024-02-23 01:30:04,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23dc7b06-1521-4a10-8b4f-b08e6e450d84] received 2024-02-23T01:30:04.676267804Z [2024-02-23 01:30:04,675: INFO/ForkPoolWorker-15] [23dc7b06-1521-4a10-8b4f-b08e6e450d84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:30:04.679389886Z [2024-02-23 01:30:04,678: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ce5e77a0-5af8-4fda-bc17-ea6c70b78a63] succeeded in 3.78755899799944s: None 2024-02-23T01:30:05.016811635Z [2024-02-23 01:30:05,013: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:30:05.054124951Z [2024-02-23 01:30:05,053: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[64e7c7f1-9ef7-45da-abdc-d5cdae4b3e7b] succeeded in 4.144923597000343s: None 2024-02-23T01:30:06.133041084Z [2024-02-23 01:30:06,132: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:30:06.136447710Z [2024-02-23 01:30:06,135: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:06.157182708Z [2024-02-23 01:30:06,156: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:30:06.159450190Z [2024-02-23 01:30:06,159: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:30:06.159569153Z [2024-02-23 01:30:06,159: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:30:06.159768977Z [2024-02-23 01:30:06,159: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:30:06.159840962Z [2024-02-23 01:30:06,159: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:30:06.160188167Z [2024-02-23 01:30:06,160: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:30:06.160607549Z [2024-02-23 01:30:06,160: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:30:06.264485077Z [2024-02-23 01:30:06,264: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:06.849612694Z [2024-02-23 01:30:06,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23dc7b06-1521-4a10-8b4f-b08e6e450d84] succeeded in 2.179407147999882s: None 2024-02-23T01:30:07.416385481Z [2024-02-23 01:30:07,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3526b010-b65d-4e4a-a333-67bd400ffb0a] received 2024-02-23T01:30:07.435303011Z [2024-02-23 01:30:07,435: INFO/ForkPoolWorker-15] [3526b010-b65d-4e4a-a333-67bd400ffb0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:30:07.740471542Z [2024-02-23 01:30:07,737: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:30:08.891119422Z [2024-02-23 01:30:08,890: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:30:08.894469165Z [2024-02-23 01:30:08,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:08.919921182Z [2024-02-23 01:30:08,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:30:08.922427235Z [2024-02-23 01:30:08,922: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:30:08.922686932Z [2024-02-23 01:30:08,922: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:30:08.923270451Z [2024-02-23 01:30:08,922: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:30:08.923573276Z [2024-02-23 01:30:08,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:30:08.924170740Z [2024-02-23 01:30:08,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:30:08.924520440Z [2024-02-23 01:30:08,924: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:30:09.029227907Z [2024-02-23 01:30:09,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:09.567962252Z [2024-02-23 01:30:09,567: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3526b010-b65d-4e4a-a333-67bd400ffb0a] succeeded in 2.1468884720006827s: None 2024-02-23T01:30:09.770879800Z [2024-02-23 01:30:09,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16c6dd42-1a97-4c68-b4ae-5f8799956edd] received 2024-02-23T01:30:09.777541782Z [2024-02-23 01:30:09,777: INFO/ForkPoolWorker-15] [16c6dd42-1a97-4c68-b4ae-5f8799956edd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:30:10.198104946Z [2024-02-23 01:30:10,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:30:11.391788469Z [2024-02-23 01:30:11,391: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:30:11.395292007Z [2024-02-23 01:30:11,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:30:11.417575334Z [2024-02-23 01:30:11,417: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:30:11.419162234Z [2024-02-23 01:30:11,418: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:30:11.419288222Z [2024-02-23 01:30:11,419: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:30:11.419391621Z [2024-02-23 01:30:11,419: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:30:11.419432866Z [2024-02-23 01:30:11,419: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:30:11.419653624Z [2024-02-23 01:30:11,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:30:11.419681275Z [2024-02-23 01:30:11,419: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:30:11.510270426Z [2024-02-23 01:30:11,509: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:30:12.154735499Z [2024-02-23 01:30:12,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16c6dd42-1a97-4c68-b4ae-5f8799956edd] succeeded in 2.3821271309998338s: None 2024-02-23T01:31:01.131730617Z [2024-02-23 01:31:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26cc90bd-0685-41a1-9f21-c05b8a3d3b3c] received 2024-02-23T01:31:01.133466115Z [2024-02-23 01:31:01,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a67b1a7f-1a87-4e24-9d36-076026e838cf] received 2024-02-23T01:31:01.135262149Z [2024-02-23 01:31:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a7f180f-9dc5-441d-89ca-307a01562969] received 2024-02-23T01:31:01.139538415Z [2024-02-23 01:31:01,139: INFO/ForkPoolWorker-16] [a67b1a7f-1a87-4e24-9d36-076026e838cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:31:01.142027827Z [2024-02-23 01:31:01,141: INFO/ForkPoolWorker-15] [26cc90bd-0685-41a1-9f21-c05b8a3d3b3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:31:01.143871265Z [2024-02-23 01:31:01,143: INFO/ForkPoolWorker-1] [8a7f180f-9dc5-441d-89ca-307a01562969] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:31:01.426925824Z [2024-02-23 01:31:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:31:01.451257178Z [2024-02-23 01:31:01,448: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:31:01.479870353Z [2024-02-23 01:31:01,476: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:31:01.615436444Z [2024-02-23 01:31:01,615: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:31:01.619252201Z [2024-02-23 01:31:01,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:31:01.646947194Z [2024-02-23 01:31:01,646: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:31:01.651916235Z [2024-02-23 01:31:01,651: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:31:01.652129655Z [2024-02-23 01:31:01,651: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:31:01.652271257Z [2024-02-23 01:31:01,652: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:31:01.652615719Z [2024-02-23 01:31:01,652: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:31:01.753406198Z [2024-02-23 01:31:01,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:31:02.378524869Z [2024-02-23 01:31:02,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26cc90bd-0685-41a1-9f21-c05b8a3d3b3c] succeeded in 1.245361672999934s: None 2024-02-23T01:31:02.626589741Z [2024-02-23 01:31:02,626: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:31:02.631377621Z [2024-02-23 01:31:02,630: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:31:02.661210929Z [2024-02-23 01:31:02,660: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:31:02.662528449Z [2024-02-23 01:31:02,662: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:31:02.662542405Z [2024-02-23 01:31:02,662: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:31:02.662686051Z [2024-02-23 01:31:02,662: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:31:02.662694073Z [2024-02-23 01:31:02,662: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:31:02.662981051Z [2024-02-23 01:31:02,662: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:31:02.663106324Z [2024-02-23 01:31:02,662: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:31:02.684021508Z [2024-02-23 01:31:02,683: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:31:02.687467559Z [2024-02-23 01:31:02,686: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:31:02.715698437Z [2024-02-23 01:31:02,715: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:31:02.718888554Z [2024-02-23 01:31:02,718: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:31:02.719122559Z [2024-02-23 01:31:02,718: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:31:02.721905873Z [2024-02-23 01:31:02,721: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:31:02.722070994Z [2024-02-23 01:31:02,721: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:31:02.722452928Z [2024-02-23 01:31:02,722: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:31:02.722621835Z [2024-02-23 01:31:02,722: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:31:02.752872374Z [2024-02-23 01:31:02,752: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:31:02.804828301Z [2024-02-23 01:31:02,804: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:31:04.179170779Z [2024-02-23 01:31:04,178: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a67b1a7f-1a87-4e24-9d36-076026e838cf] succeeded in 3.0440973009999652s: None 2024-02-23T01:31:04.665618894Z [2024-02-23 01:31:04,665: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a7f180f-9dc5-441d-89ca-307a01562969] succeeded in 3.5287283229999957s: None 2024-02-23T01:32:00.595517442Z [2024-02-23 01:32:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c17cbc6-54e1-476b-97c0-3fa5f67591be] received 2024-02-23T01:32:00.602020893Z [2024-02-23 01:32:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b027df68-f127-4fe6-aefa-f78b73fe96fe] received 2024-02-23T01:32:00.602356920Z [2024-02-23 01:32:00,602: INFO/ForkPoolWorker-15] [7c17cbc6-54e1-476b-97c0-3fa5f67591be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:32:00.604984975Z [2024-02-23 01:32:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b147d356-1c08-4c81-8deb-f9cdda3afa45] received 2024-02-23T01:32:00.608741122Z [2024-02-23 01:32:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89cab4d1-6c93-4dac-89f8-52d6051765fe] received 2024-02-23T01:32:00.613019654Z [2024-02-23 01:32:00,612: INFO/ForkPoolWorker-1] [b147d356-1c08-4c81-8deb-f9cdda3afa45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:32:00.619591685Z [2024-02-23 01:32:00,619: INFO/ForkPoolWorker-16] [b027df68-f127-4fe6-aefa-f78b73fe96fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:32:00.631527743Z [2024-02-23 01:32:00,631: INFO/ForkPoolWorker-2] [89cab4d1-6c93-4dac-89f8-52d6051765fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:32:00.923605680Z [2024-02-23 01:32:00,920: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:32:00.934509045Z [2024-02-23 01:32:00,931: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:32:01.053058726Z [2024-02-23 01:32:01,046: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:32:01.159278413Z [2024-02-23 01:32:01,155: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:32:01.240804135Z [2024-02-23 01:32:01,240: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:32:01.248726418Z [2024-02-23 01:32:01,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:32:01.307865949Z [2024-02-23 01:32:01,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:32:01.314530091Z [2024-02-23 01:32:01,314: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:32:01.314648943Z [2024-02-23 01:32:01,314: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:32:01.314707797Z [2024-02-23 01:32:01,314: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:32:01.315214524Z [2024-02-23 01:32:01,314: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:32:01.436274844Z [2024-02-23 01:32:01,436: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:32:01.447491920Z [2024-02-23 01:32:01,447: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:32:02.162141950Z [2024-02-23 01:32:02,161: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b027df68-f127-4fe6-aefa-f78b73fe96fe] succeeded in 1.555193023999891s: None 2024-02-23T01:32:02.216124584Z [2024-02-23 01:32:02,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c17cbc6-54e1-476b-97c0-3fa5f67591be] succeeded in 1.6192997449998074s: None 2024-02-23T01:32:02.489170178Z [2024-02-23 01:32:02,488: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:32:02.492691244Z [2024-02-23 01:32:02,491: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:32:02.519705427Z [2024-02-23 01:32:02,519: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:32:02.521459536Z [2024-02-23 01:32:02,520: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:32:02.521479439Z [2024-02-23 01:32:02,521: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:32:02.521497962Z [2024-02-23 01:32:02,521: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:32:02.521542744Z [2024-02-23 01:32:02,521: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:32:02.521820001Z [2024-02-23 01:32:02,521: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:32:02.521832659Z [2024-02-23 01:32:02,521: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:32:02.586827424Z [2024-02-23 01:32:02,586: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:32:02.590201066Z [2024-02-23 01:32:02,589: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:32:02.613869931Z [2024-02-23 01:32:02,613: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:32:02.615108130Z [2024-02-23 01:32:02,614: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:32:02.615122876Z [2024-02-23 01:32:02,615: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:32:02.615236144Z [2024-02-23 01:32:02,615: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:32:02.615248384Z [2024-02-23 01:32:02,615: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:32:02.615474494Z [2024-02-23 01:32:02,615: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:32:02.615481715Z [2024-02-23 01:32:02,615: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:32:02.615491075Z [2024-02-23 01:32:02,615: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:32:02.711051908Z [2024-02-23 01:32:02,710: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:32:04.308064728Z [2024-02-23 01:32:04,307: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b147d356-1c08-4c81-8deb-f9cdda3afa45] succeeded in 3.701474856000459s: None 2024-02-23T01:32:04.889091620Z [2024-02-23 01:32:04,888: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[89cab4d1-6c93-4dac-89f8-52d6051765fe] succeeded in 4.272960160999901s: None 2024-02-23T01:33:01.056406712Z [2024-02-23 01:33:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85f2c33a-97bc-45d6-8d27-c1009f4b80ff] received 2024-02-23T01:33:01.065886371Z [2024-02-23 01:33:01,065: INFO/ForkPoolWorker-15] [85f2c33a-97bc-45d6-8d27-c1009f4b80ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:33:01.070915298Z [2024-02-23 01:33:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2406f3d-1922-4e73-be03-318e2cdbf8e4] received 2024-02-23T01:33:01.084409703Z [2024-02-23 01:33:01,084: INFO/ForkPoolWorker-16] [f2406f3d-1922-4e73-be03-318e2cdbf8e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:33:01.099831748Z [2024-02-23 01:33:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b04b032c-a2a5-4b0d-8165-efe6366e0c89] received 2024-02-23T01:33:01.107464220Z [2024-02-23 01:33:01,107: INFO/ForkPoolWorker-1] [b04b032c-a2a5-4b0d-8165-efe6366e0c89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:33:01.395628419Z [2024-02-23 01:33:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:33:01.396595280Z [2024-02-23 01:33:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:33:01.525048183Z [2024-02-23 01:33:01,522: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:33:01.699863357Z [2024-02-23 01:33:01,699: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:33:01.705048688Z [2024-02-23 01:33:01,704: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:33:01.731178809Z [2024-02-23 01:33:01,730: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:33:01.738524435Z [2024-02-23 01:33:01,738: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:33:01.738648841Z [2024-02-23 01:33:01,738: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:33:01.738663975Z [2024-02-23 01:33:01,738: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:33:01.739233803Z [2024-02-23 01:33:01,738: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:33:01.863723656Z [2024-02-23 01:33:01,863: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:33:02.573818785Z [2024-02-23 01:33:02,573: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b04b032c-a2a5-4b0d-8165-efe6366e0c89] succeeded in 1.4717295689997627s: None 2024-02-23T01:33:02.755012517Z [2024-02-23 01:33:02,739: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:33:02.756078511Z [2024-02-23 01:33:02,755: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:33:02.772959869Z [2024-02-23 01:33:02,772: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:33:02.774334842Z [2024-02-23 01:33:02,774: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:33:02.774630485Z [2024-02-23 01:33:02,774: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:33:02.774727054Z [2024-02-23 01:33:02,774: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:33:02.775140534Z [2024-02-23 01:33:02,775: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:33:02.775330274Z [2024-02-23 01:33:02,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:33:02.775363426Z [2024-02-23 01:33:02,775: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:33:02.825201327Z [2024-02-23 01:33:02,824: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:33:02.828720635Z [2024-02-23 01:33:02,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:33:02.851365548Z [2024-02-23 01:33:02,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:33:02.853209353Z [2024-02-23 01:33:02,852: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:33:02.853261698Z [2024-02-23 01:33:02,853: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:33:02.853349955Z [2024-02-23 01:33:02,853: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:33:02.853377610Z [2024-02-23 01:33:02,853: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:33:02.854153442Z [2024-02-23 01:33:02,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:33:02.854237323Z [2024-02-23 01:33:02,854: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:33:02.859891824Z [2024-02-23 01:33:02,859: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:33:02.943122981Z [2024-02-23 01:33:02,942: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:33:04.580045223Z [2024-02-23 01:33:04,579: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2406f3d-1922-4e73-be03-318e2cdbf8e4] succeeded in 3.504726056000436s: None 2024-02-23T01:33:05.193626173Z [2024-02-23 01:33:05,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85f2c33a-97bc-45d6-8d27-c1009f4b80ff] succeeded in 4.134857214000476s: None 2024-02-23T01:34:01.084006832Z [2024-02-23 01:34:01,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a59d85b5-dd9a-43b4-b5af-a44dfd892d7f] received 2024-02-23T01:34:01.091453520Z [2024-02-23 01:34:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f52852c3-90b3-45d6-ac22-7bb6e87a1be9] received 2024-02-23T01:34:01.093222006Z [2024-02-23 01:34:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93d1cf6d-f802-4588-818e-229cb3b403b4] received 2024-02-23T01:34:01.096873689Z [2024-02-23 01:34:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14ce2ea6-bbd9-4b41-971f-da5cbf540d52] received 2024-02-23T01:34:01.100035355Z [2024-02-23 01:34:01,099: INFO/ForkPoolWorker-15] [a59d85b5-dd9a-43b4-b5af-a44dfd892d7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:34:01.103737836Z [2024-02-23 01:34:01,103: INFO/ForkPoolWorker-16] [f52852c3-90b3-45d6-ac22-7bb6e87a1be9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:34:01.118699372Z [2024-02-23 01:34:01,118: INFO/ForkPoolWorker-2] [14ce2ea6-bbd9-4b41-971f-da5cbf540d52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:34:01.118746913Z [2024-02-23 01:34:01,118: INFO/ForkPoolWorker-1] [93d1cf6d-f802-4588-818e-229cb3b403b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:34:01.414070899Z [2024-02-23 01:34:01,410: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:34:01.480371428Z [2024-02-23 01:34:01,477: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:34:01.494112531Z [2024-02-23 01:34:01,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:34:01.510319942Z [2024-02-23 01:34:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:34:01.598524959Z [2024-02-23 01:34:01,598: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:34:01.607432928Z [2024-02-23 01:34:01,606: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:34:01.665581939Z [2024-02-23 01:34:01,665: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:34:01.673143684Z [2024-02-23 01:34:01,672: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:34:01.673218710Z [2024-02-23 01:34:01,673: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:34:01.673254596Z [2024-02-23 01:34:01,673: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:34:01.673490026Z [2024-02-23 01:34:01,673: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:34:01.822051239Z [2024-02-23 01:34:01,821: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:34:01.877559885Z [2024-02-23 01:34:01,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:34:02.478365786Z [2024-02-23 01:34:02,477: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[14ce2ea6-bbd9-4b41-971f-da5cbf540d52] succeeded in 1.3791103440007646s: None 2024-02-23T01:34:02.532698461Z [2024-02-23 01:34:02,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a59d85b5-dd9a-43b4-b5af-a44dfd892d7f] succeeded in 1.4430244310005946s: None 2024-02-23T01:34:02.793288573Z [2024-02-23 01:34:02,792: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:34:02.796615298Z [2024-02-23 01:34:02,796: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:34:02.820079106Z [2024-02-23 01:34:02,819: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:34:02.822447715Z [2024-02-23 01:34:02,822: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:34:02.822471574Z [2024-02-23 01:34:02,822: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:34:02.822623405Z [2024-02-23 01:34:02,822: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:34:02.822667539Z [2024-02-23 01:34:02,822: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:34:02.823070892Z [2024-02-23 01:34:02,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:34:02.823131493Z [2024-02-23 01:34:02,823: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:34:02.850851617Z [2024-02-23 01:34:02,850: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:34:02.854770002Z [2024-02-23 01:34:02,854: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:34:02.892606680Z [2024-02-23 01:34:02,892: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:34:02.894046253Z [2024-02-23 01:34:02,893: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:34:02.894062107Z [2024-02-23 01:34:02,893: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:34:02.895232034Z [2024-02-23 01:34:02,894: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:34:02.895296921Z [2024-02-23 01:34:02,895: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:34:02.895682735Z [2024-02-23 01:34:02,895: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:34:02.895694502Z [2024-02-23 01:34:02,895: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:34:02.927786229Z [2024-02-23 01:34:02,927: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:34:02.995664745Z [2024-02-23 01:34:02,995: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:34:05.758727688Z [2024-02-23 01:34:05,758: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f52852c3-90b3-45d6-ac22-7bb6e87a1be9] succeeded in 4.663381041000321s: None 2024-02-23T01:34:06.857049307Z [2024-02-23 01:34:06,856: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[93d1cf6d-f802-4588-818e-229cb3b403b4] succeeded in 5.761417436000556s: None 2024-02-23T01:35:00.824899133Z [2024-02-23 01:35:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edeea32a-a9e2-43cf-896b-a494d52cb87d] received 2024-02-23T01:35:00.829552782Z [2024-02-23 01:35:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d65fe062-2fba-4d43-8704-e2764784081c] received 2024-02-23T01:35:00.831552969Z [2024-02-23 01:35:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f42c9f4a-77e9-41fa-bb7f-a643bbcc93bb] received 2024-02-23T01:35:00.833303599Z [2024-02-23 01:35:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[577914c9-c4ff-4ab5-b29f-c95bc8c003f2] received 2024-02-23T01:35:00.841185476Z [2024-02-23 01:35:00,840: INFO/ForkPoolWorker-2] [577914c9-c4ff-4ab5-b29f-c95bc8c003f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:35:00.843685650Z [2024-02-23 01:35:00,843: INFO/ForkPoolWorker-1] [f42c9f4a-77e9-41fa-bb7f-a643bbcc93bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:35:00.849336150Z [2024-02-23 01:35:00,849: INFO/ForkPoolWorker-15] [edeea32a-a9e2-43cf-896b-a494d52cb87d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:35:00.849711042Z [2024-02-23 01:35:00,849: INFO/ForkPoolWorker-16] [d65fe062-2fba-4d43-8704-e2764784081c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:35:01.158686310Z [2024-02-23 01:35:01,155: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:35:01.182008404Z [2024-02-23 01:35:01,173: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:35:01.213669380Z [2024-02-23 01:35:01,210: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:35:01.223792699Z [2024-02-23 01:35:01,219: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:35:01.464942791Z [2024-02-23 01:35:01,464: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:35:01.469303911Z [2024-02-23 01:35:01,468: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:01.512688053Z [2024-02-23 01:35:01,512: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:35:01.517159191Z [2024-02-23 01:35:01,516: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:35:01.518187964Z [2024-02-23 01:35:01,517: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:35:01.519148889Z [2024-02-23 01:35:01,518: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:35:01.519341308Z [2024-02-23 01:35:01,519: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:35:01.639012229Z [2024-02-23 01:35:01,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:02.187640491Z [2024-02-23 01:35:02,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f42c9f4a-77e9-41fa-bb7f-a643bbcc93bb] succeeded in 1.354605215000447s: None 2024-02-23T01:35:02.389714357Z [2024-02-23 01:35:02,389: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:35:02.393009487Z [2024-02-23 01:35:02,392: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:02.416417527Z [2024-02-23 01:35:02,415: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:35:02.418799698Z [2024-02-23 01:35:02,418: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:35:02.419890553Z [2024-02-23 01:35:02,419: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:35:02.420010398Z [2024-02-23 01:35:02,419: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:35:02.420090935Z [2024-02-23 01:35:02,420: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:35:02.421165271Z [2024-02-23 01:35:02,420: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:35:02.421287792Z [2024-02-23 01:35:02,421: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:35:02.424723461Z [2024-02-23 01:35:02,424: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:35:02.428310942Z [2024-02-23 01:35:02,427: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:02.452220917Z [2024-02-23 01:35:02,451: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:35:02.453555864Z [2024-02-23 01:35:02,453: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:35:02.453573408Z [2024-02-23 01:35:02,453: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:35:02.453696641Z [2024-02-23 01:35:02,453: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:35:02.453732237Z [2024-02-23 01:35:02,453: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:35:02.454007464Z [2024-02-23 01:35:02,453: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:35:02.454033682Z [2024-02-23 01:35:02,453: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:35:02.508194950Z [2024-02-23 01:35:02,507: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:02.561530542Z [2024-02-23 01:35:02,561: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:02.618609511Z [2024-02-23 01:35:02,617: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:35:02.624211766Z [2024-02-23 01:35:02,623: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:02.651220270Z [2024-02-23 01:35:02,650: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:35:02.653166546Z [2024-02-23 01:35:02,652: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:35:02.653243404Z [2024-02-23 01:35:02,653: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:35:02.653485165Z [2024-02-23 01:35:02,653: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:35:02.653604274Z [2024-02-23 01:35:02,653: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:35:02.653940054Z [2024-02-23 01:35:02,653: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:35:02.654030603Z [2024-02-23 01:35:02,653: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:35:02.759391613Z [2024-02-23 01:35:02,759: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:03.489843954Z [2024-02-23 01:35:03,489: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d65fe062-2fba-4d43-8704-e2764784081c] succeeded in 2.657931871999608s: None 2024-02-23T01:35:03.913016420Z [2024-02-23 01:35:03,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c950e6eb-33a5-4371-b3e5-149ff4033af7] received 2024-02-23T01:35:03.929185409Z [2024-02-23 01:35:03,928: INFO/ForkPoolWorker-16] [c950e6eb-33a5-4371-b3e5-149ff4033af7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:35:04.223374820Z [2024-02-23 01:35:04,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edeea32a-a9e2-43cf-896b-a494d52cb87d] succeeded in 3.3948931149998316s: None 2024-02-23T01:35:04.302512453Z [2024-02-23 01:35:04,299: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:35:04.609172189Z [2024-02-23 01:35:04,608: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[577914c9-c4ff-4ab5-b29f-c95bc8c003f2] succeeded in 3.773548010999548s: None 2024-02-23T01:35:05.469454405Z [2024-02-23 01:35:05,469: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:35:05.472854739Z [2024-02-23 01:35:05,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:05.505487437Z [2024-02-23 01:35:05,505: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:35:05.508122581Z [2024-02-23 01:35:05,507: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:35:05.508239664Z [2024-02-23 01:35:05,507: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:35:05.508496417Z [2024-02-23 01:35:05,508: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:35:05.508616432Z [2024-02-23 01:35:05,508: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:35:05.509407562Z [2024-02-23 01:35:05,509: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:35:05.510260380Z [2024-02-23 01:35:05,509: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:35:05.596165623Z [2024-02-23 01:35:05,595: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:06.278127562Z [2024-02-23 01:35:06,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c950e6eb-33a5-4371-b3e5-149ff4033af7] succeeded in 2.3599106430001484s: None 2024-02-23T01:35:06.308896531Z [2024-02-23 01:35:06,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1b83bf9-515b-469a-99e0-41c9841dc316] received 2024-02-23T01:35:06.317341056Z [2024-02-23 01:35:06,316: INFO/ForkPoolWorker-15] [f1b83bf9-515b-469a-99e0-41c9841dc316] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:35:06.646181515Z [2024-02-23 01:35:06,643: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:35:07.798130754Z [2024-02-23 01:35:07,797: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:35:07.802249158Z [2024-02-23 01:35:07,801: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:07.824616978Z [2024-02-23 01:35:07,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:35:07.826352688Z [2024-02-23 01:35:07,826: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:35:07.826580378Z [2024-02-23 01:35:07,826: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:35:07.826888331Z [2024-02-23 01:35:07,826: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:35:07.827079617Z [2024-02-23 01:35:07,826: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:35:07.827541001Z [2024-02-23 01:35:07,827: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:35:07.827759150Z [2024-02-23 01:35:07,827: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:35:07.970919666Z [2024-02-23 01:35:07,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:08.575323202Z [2024-02-23 01:35:08,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1b83bf9-515b-469a-99e0-41c9841dc316] succeeded in 2.2632024939994153s: None 2024-02-23T01:35:08.699467502Z [2024-02-23 01:35:08,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67d51170-dbe9-4f91-90f5-8095c2e95a50] received 2024-02-23T01:35:08.711784256Z [2024-02-23 01:35:08,711: INFO/ForkPoolWorker-15] [67d51170-dbe9-4f91-90f5-8095c2e95a50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:35:08.997111254Z [2024-02-23 01:35:08,994: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:35:10.140633553Z [2024-02-23 01:35:10,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:35:10.144159209Z [2024-02-23 01:35:10,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:35:10.167717533Z [2024-02-23 01:35:10,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:35:10.169060479Z [2024-02-23 01:35:10,168: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:35:10.169085370Z [2024-02-23 01:35:10,168: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:35:10.169240158Z [2024-02-23 01:35:10,169: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:35:10.169253187Z [2024-02-23 01:35:10,169: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:35:10.169618327Z [2024-02-23 01:35:10,169: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:35:10.169679504Z [2024-02-23 01:35:10,169: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:35:10.266006578Z [2024-02-23 01:35:10,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:35:10.879665973Z [2024-02-23 01:35:10,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67d51170-dbe9-4f91-90f5-8095c2e95a50] succeeded in 2.1772842270002s: None 2024-02-23T01:36:00.235960722Z [2024-02-23 01:36:00,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b766d11-62f8-4d1b-af08-8906cf8430e2] received 2024-02-23T01:36:00.245643842Z [2024-02-23 01:36:00,245: INFO/ForkPoolWorker-15] [3b766d11-62f8-4d1b-af08-8906cf8430e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:36:00.246753259Z [2024-02-23 01:36:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67575bc0-d20d-43a2-b02a-d14909522b7f] received 2024-02-23T01:36:00.257670723Z [2024-02-23 01:36:00,257: INFO/ForkPoolWorker-16] [67575bc0-d20d-43a2-b02a-d14909522b7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:36:00.262517254Z [2024-02-23 01:36:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84f4e4b7-438b-4688-91c6-7f5972ed6d4b] received 2024-02-23T01:36:00.266971559Z [2024-02-23 01:36:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c856dd64-008d-466c-8c51-3441e31aef4c] received 2024-02-23T01:36:00.270174710Z [2024-02-23 01:36:00,269: INFO/ForkPoolWorker-1] [84f4e4b7-438b-4688-91c6-7f5972ed6d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:36:00.290965396Z [2024-02-23 01:36:00,290: INFO/ForkPoolWorker-2] [c856dd64-008d-466c-8c51-3441e31aef4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:36:00.584866603Z [2024-02-23 01:36:00,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:36:00.635503185Z [2024-02-23 01:36:00,632: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:36:00.738734911Z [2024-02-23 01:36:00,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:36:00.764909873Z [2024-02-23 01:36:00,757: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:36:00.831439433Z [2024-02-23 01:36:00,830: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:36:00.835266458Z [2024-02-23 01:36:00,834: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:36:00.873305806Z [2024-02-23 01:36:00,873: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:36:00.874191031Z [2024-02-23 01:36:00,873: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:36:00.874305678Z [2024-02-23 01:36:00,874: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:36:00.874377407Z [2024-02-23 01:36:00,874: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:36:00.874649844Z [2024-02-23 01:36:00,874: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:36:00.935444732Z [2024-02-23 01:36:00,935: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:36:00.971649411Z [2024-02-23 01:36:00,971: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:36:01.595954640Z [2024-02-23 01:36:01,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b766d11-62f8-4d1b-af08-8906cf8430e2] succeeded in 1.3577527519992145s: None 2024-02-23T01:36:01.716581152Z [2024-02-23 01:36:01,716: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67575bc0-d20d-43a2-b02a-d14909522b7f] succeeded in 1.467436805000034s: None 2024-02-23T01:36:02.200494556Z [2024-02-23 01:36:02,200: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:36:02.204135237Z [2024-02-23 01:36:02,203: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:36:02.221197651Z [2024-02-23 01:36:02,220: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:36:02.225264739Z [2024-02-23 01:36:02,224: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:36:02.234435172Z [2024-02-23 01:36:02,234: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:36:02.236424014Z [2024-02-23 01:36:02,236: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:36:02.236756380Z [2024-02-23 01:36:02,236: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:36:02.236947242Z [2024-02-23 01:36:02,236: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:36:02.237077682Z [2024-02-23 01:36:02,236: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:36:02.237940680Z [2024-02-23 01:36:02,237: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:36:02.238084028Z [2024-02-23 01:36:02,237: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:36:02.249833149Z [2024-02-23 01:36:02,249: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:36:02.252791126Z [2024-02-23 01:36:02,252: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:36:02.252882687Z [2024-02-23 01:36:02,252: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:36:02.253073690Z [2024-02-23 01:36:02,252: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:36:02.253144541Z [2024-02-23 01:36:02,253: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:36:02.253590717Z [2024-02-23 01:36:02,253: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:36:02.253693474Z [2024-02-23 01:36:02,253: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:36:02.370919913Z [2024-02-23 01:36:02,366: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:36:02.384876892Z [2024-02-23 01:36:02,384: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:36:03.917107910Z [2024-02-23 01:36:03,916: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[84f4e4b7-438b-4688-91c6-7f5972ed6d4b] succeeded in 3.6522045699994123s: None 2024-02-23T01:36:04.384578688Z [2024-02-23 01:36:04,384: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c856dd64-008d-466c-8c51-3441e31aef4c] succeeded in 4.115675878000729s: None 2024-02-23T01:37:00.656282440Z [2024-02-23 01:37:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25601755-07b7-4f04-b298-ec7cf1ab8ee4] received 2024-02-23T01:37:00.662073937Z [2024-02-23 01:37:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[887ee8aa-abcc-4608-8958-f663ce5f1e73] received 2024-02-23T01:37:00.664152071Z [2024-02-23 01:37:00,663: INFO/ForkPoolWorker-15] [25601755-07b7-4f04-b298-ec7cf1ab8ee4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:37:00.668216635Z [2024-02-23 01:37:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[895347ff-95cc-45f5-8bef-296d9d7f78bb] received 2024-02-23T01:37:00.672361731Z [2024-02-23 01:37:00,672: INFO/ForkPoolWorker-16] [887ee8aa-abcc-4608-8958-f663ce5f1e73] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:37:00.684328033Z [2024-02-23 01:37:00,684: INFO/ForkPoolWorker-1] [895347ff-95cc-45f5-8bef-296d9d7f78bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:37:00.970265945Z [2024-02-23 01:37:00,966: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:37:01.016772160Z [2024-02-23 01:37:01,013: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:37:01.043956934Z [2024-02-23 01:37:01,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:37:01.191006916Z [2024-02-23 01:37:01,190: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:37:01.197299019Z [2024-02-23 01:37:01,196: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:37:01.227676941Z [2024-02-23 01:37:01,227: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:37:01.229217113Z [2024-02-23 01:37:01,228: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:37:01.229532164Z [2024-02-23 01:37:01,229: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:37:01.229700699Z [2024-02-23 01:37:01,229: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:37:01.230019263Z [2024-02-23 01:37:01,229: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:37:01.359718910Z [2024-02-23 01:37:01,359: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:37:02.152308030Z [2024-02-23 01:37:02,151: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[887ee8aa-abcc-4608-8958-f663ce5f1e73] succeeded in 1.4877622909998536s: None 2024-02-23T01:37:02.429750802Z [2024-02-23 01:37:02,429: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:37:02.433375835Z [2024-02-23 01:37:02,432: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:37:02.459945703Z [2024-02-23 01:37:02,459: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:37:02.461969016Z [2024-02-23 01:37:02,461: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:37:02.462178936Z [2024-02-23 01:37:02,461: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:37:02.462450257Z [2024-02-23 01:37:02,462: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:37:02.462488371Z [2024-02-23 01:37:02,462: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:37:02.463136369Z [2024-02-23 01:37:02,462: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:37:02.463331573Z [2024-02-23 01:37:02,463: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:37:02.534442195Z [2024-02-23 01:37:02,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:37:02.538135663Z [2024-02-23 01:37:02,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:37:02.562768989Z [2024-02-23 01:37:02,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:37:02.564883105Z [2024-02-23 01:37:02,564: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:37:02.565182912Z [2024-02-23 01:37:02,564: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:37:02.565499595Z [2024-02-23 01:37:02,565: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:37:02.565672499Z [2024-02-23 01:37:02,565: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:37:02.566062623Z [2024-02-23 01:37:02,565: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:37:02.566274806Z [2024-02-23 01:37:02,566: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:37:02.583244075Z [2024-02-23 01:37:02,582: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:37:02.693862159Z [2024-02-23 01:37:02,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:37:04.801562117Z [2024-02-23 01:37:04,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25601755-07b7-4f04-b298-ec7cf1ab8ee4] succeeded in 4.143162530999689s: None 2024-02-23T01:37:04.805063333Z [2024-02-23 01:37:04,804: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[895347ff-95cc-45f5-8bef-296d9d7f78bb] succeeded in 4.134954947000551s: None 2024-02-23T01:38:00.739607788Z [2024-02-23 01:38:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fec66e6-a43d-42c7-9f0f-53b3098147d5] received 2024-02-23T01:38:00.741438791Z [2024-02-23 01:38:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e02a066-a86a-4318-8bd6-d6a5e14c4cb6] received 2024-02-23T01:38:00.745987376Z [2024-02-23 01:38:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80f69e06-488c-47da-8eec-de0a11d6795a] received 2024-02-23T01:38:00.748667177Z [2024-02-23 01:38:00,748: INFO/ForkPoolWorker-16] [0e02a066-a86a-4318-8bd6-d6a5e14c4cb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:38:00.750429814Z [2024-02-23 01:38:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e54efe7-76d9-462a-aef0-49c21ebc128d] received 2024-02-23T01:38:00.753489992Z [2024-02-23 01:38:00,753: INFO/ForkPoolWorker-15] [8fec66e6-a43d-42c7-9f0f-53b3098147d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:38:00.762230376Z [2024-02-23 01:38:00,761: INFO/ForkPoolWorker-2] [0e54efe7-76d9-462a-aef0-49c21ebc128d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:38:00.763861386Z [2024-02-23 01:38:00,763: INFO/ForkPoolWorker-1] [80f69e06-488c-47da-8eec-de0a11d6795a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:38:01.076627052Z [2024-02-23 01:38:01,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:38:01.121055801Z [2024-02-23 01:38:01,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:38:01.170601503Z [2024-02-23 01:38:01,166: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:38:01.181559209Z [2024-02-23 01:38:01,178: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:38:01.350375701Z [2024-02-23 01:38:01,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:38:01.394660785Z [2024-02-23 01:38:01,394: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:38:01.401759918Z [2024-02-23 01:38:01,401: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:38:01.430505929Z [2024-02-23 01:38:01,430: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:38:01.431629863Z [2024-02-23 01:38:01,431: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:38:01.431688792Z [2024-02-23 01:38:01,431: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:38:01.431726273Z [2024-02-23 01:38:01,431: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:38:01.431935569Z [2024-02-23 01:38:01,431: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:38:01.544333583Z [2024-02-23 01:38:01,544: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:38:02.312429890Z [2024-02-23 01:38:02,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fec66e6-a43d-42c7-9f0f-53b3098147d5] succeeded in 1.5712136040001496s: None 2024-02-23T01:38:02.387836194Z [2024-02-23 01:38:02,386: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e54efe7-76d9-462a-aef0-49c21ebc128d] succeeded in 1.6344381429998975s: None 2024-02-23T01:38:02.581217688Z [2024-02-23 01:38:02,580: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:38:02.584786735Z [2024-02-23 01:38:02,584: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:38:02.605649278Z [2024-02-23 01:38:02,605: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:38:02.610161532Z [2024-02-23 01:38:02,609: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:38:02.625851528Z [2024-02-23 01:38:02,625: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:38:02.629227632Z [2024-02-23 01:38:02,628: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:38:02.629694162Z [2024-02-23 01:38:02,629: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:38:02.629978669Z [2024-02-23 01:38:02,629: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:38:02.630109075Z [2024-02-23 01:38:02,629: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:38:02.630963212Z [2024-02-23 01:38:02,630: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:38:02.631102798Z [2024-02-23 01:38:02,630: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:38:02.653575209Z [2024-02-23 01:38:02,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:38:02.655892060Z [2024-02-23 01:38:02,655: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:38:02.655975083Z [2024-02-23 01:38:02,655: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:38:02.656189521Z [2024-02-23 01:38:02,655: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:38:02.656371762Z [2024-02-23 01:38:02,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:38:02.656931562Z [2024-02-23 01:38:02,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:38:02.657028551Z [2024-02-23 01:38:02,656: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:38:02.741782904Z [2024-02-23 01:38:02,741: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:38:02.810277837Z [2024-02-23 01:38:02,810: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:38:04.565682366Z [2024-02-23 01:38:04,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e02a066-a86a-4318-8bd6-d6a5e14c4cb6] succeeded in 3.8225527620006687s: None 2024-02-23T01:38:04.998925509Z [2024-02-23 01:38:04,998: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[80f69e06-488c-47da-8eec-de0a11d6795a] succeeded in 4.245180124000399s: None 2024-02-23T01:39:00.583782174Z [2024-02-23 01:39:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22b0e53e-b430-4db5-88e1-60856b6cafe3] received 2024-02-23T01:39:00.591393279Z [2024-02-23 01:39:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be6a80f8-37ab-4f4d-9018-a6ce1c023af1] received 2024-02-23T01:39:00.594622754Z [2024-02-23 01:39:00,594: INFO/ForkPoolWorker-15] [22b0e53e-b430-4db5-88e1-60856b6cafe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:39:00.598071626Z [2024-02-23 01:39:00,597: INFO/ForkPoolWorker-16] [be6a80f8-37ab-4f4d-9018-a6ce1c023af1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:39:00.598386162Z [2024-02-23 01:39:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75aa3fe7-2cef-42b8-9e49-c9702d5bb5be] received 2024-02-23T01:39:00.605322348Z [2024-02-23 01:39:00,604: INFO/ForkPoolWorker-1] [75aa3fe7-2cef-42b8-9e49-c9702d5bb5be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:39:00.908881075Z [2024-02-23 01:39:00,905: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:39:00.916418273Z [2024-02-23 01:39:00,913: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:39:00.942343977Z [2024-02-23 01:39:00,938: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:39:01.077644342Z [2024-02-23 01:39:01,077: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:39:01.082052141Z [2024-02-23 01:39:01,081: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:39:01.108102995Z [2024-02-23 01:39:01,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:39:01.109434883Z [2024-02-23 01:39:01,109: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:39:01.109661242Z [2024-02-23 01:39:01,109: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:39:01.109770063Z [2024-02-23 01:39:01,109: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:39:01.110017194Z [2024-02-23 01:39:01,109: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:39:01.215454652Z [2024-02-23 01:39:01,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:39:01.943817752Z [2024-02-23 01:39:01,943: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22b0e53e-b430-4db5-88e1-60856b6cafe3] succeeded in 1.3571980130000156s: None 2024-02-23T01:39:02.151368256Z [2024-02-23 01:39:02,150: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:39:02.154577069Z [2024-02-23 01:39:02,154: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:39:02.180108583Z [2024-02-23 01:39:02,179: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:39:02.181903928Z [2024-02-23 01:39:02,181: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:39:02.181954546Z [2024-02-23 01:39:02,181: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:39:02.182042947Z [2024-02-23 01:39:02,181: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:39:02.182059418Z [2024-02-23 01:39:02,181: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:39:02.182307423Z [2024-02-23 01:39:02,182: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:39:02.182322497Z [2024-02-23 01:39:02,182: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:39:02.266473735Z [2024-02-23 01:39:02,266: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:39:02.270023487Z [2024-02-23 01:39:02,269: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:39:02.287206468Z [2024-02-23 01:39:02,286: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:39:02.299070022Z [2024-02-23 01:39:02,298: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:39:02.301406303Z [2024-02-23 01:39:02,301: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:39:02.301881466Z [2024-02-23 01:39:02,301: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:39:02.302405039Z [2024-02-23 01:39:02,302: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:39:02.302741453Z [2024-02-23 01:39:02,302: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:39:02.303345995Z [2024-02-23 01:39:02,303: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:39:02.303605868Z [2024-02-23 01:39:02,303: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:39:02.423647415Z [2024-02-23 01:39:02,423: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:39:03.854607127Z [2024-02-23 01:39:03,854: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75aa3fe7-2cef-42b8-9e49-c9702d5bb5be] succeeded in 3.2545623339992744s: None 2024-02-23T01:39:05.106653588Z [2024-02-23 01:39:05,105: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be6a80f8-37ab-4f4d-9018-a6ce1c023af1] succeeded in 4.513270632000058s: None 2024-02-23T01:40:01.292105381Z [2024-02-23 01:40:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc369230-a14f-43fb-8b0d-fd7f7577b016] received 2024-02-23T01:40:01.299639845Z [2024-02-23 01:40:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b5042ad-2744-4293-be59-dd4c9b3a7fde] received 2024-02-23T01:40:01.301554914Z [2024-02-23 01:40:01,301: INFO/ForkPoolWorker-15] [cc369230-a14f-43fb-8b0d-fd7f7577b016] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:40:01.306514014Z [2024-02-23 01:40:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18aa6004-49ac-4876-ba0f-fc90f4732dbd] received 2024-02-23T01:40:01.318026976Z [2024-02-23 01:40:01,317: INFO/ForkPoolWorker-16] [9b5042ad-2744-4293-be59-dd4c9b3a7fde] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:40:01.325980407Z [2024-02-23 01:40:01,325: INFO/ForkPoolWorker-1] [18aa6004-49ac-4876-ba0f-fc90f4732dbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:40:01.344721103Z [2024-02-23 01:40:01,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f912c68-23c3-44c2-9664-15f8331cb3a3] received 2024-02-23T01:40:01.351472142Z [2024-02-23 01:40:01,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5f47e12-e9f2-49a9-bb51-0c0c921e6128] received 2024-02-23T01:40:01.379115529Z [2024-02-23 01:40:01,378: INFO/ForkPoolWorker-3] [c5f47e12-e9f2-49a9-bb51-0c0c921e6128] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:40:01.406535399Z [2024-02-23 01:40:01,406: INFO/ForkPoolWorker-2] [0f912c68-23c3-44c2-9664-15f8331cb3a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:40:01.773330291Z [2024-02-23 01:40:01,768: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:40:01.834852015Z [2024-02-23 01:40:01,831: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:40:02.012277202Z [2024-02-23 01:40:02,008: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:40:02.038901201Z [2024-02-23 01:40:02,038: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:40:02.042958718Z [2024-02-23 01:40:02,042: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:02.069357049Z [2024-02-23 01:40:02,069: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:40:02.071208490Z [2024-02-23 01:40:02,070: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:40:02.071478980Z [2024-02-23 01:40:02,071: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:40:02.071611729Z [2024-02-23 01:40:02,071: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:40:02.071928178Z [2024-02-23 01:40:02,071: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:40:02.194606769Z [2024-02-23 01:40:02,189: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:40:02.250766268Z [2024-02-23 01:40:02,247: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:40:02.279952987Z [2024-02-23 01:40:02,279: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:03.180141027Z [2024-02-23 01:40:03,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b5042ad-2744-4293-be59-dd4c9b3a7fde] succeeded in 1.8717474850000144s: None 2024-02-23T01:40:03.213081061Z [2024-02-23 01:40:03,212: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:03.611402099Z [2024-02-23 01:40:03,610: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T01:40:03.615844592Z [2024-02-23 01:40:03,615: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:03.642980660Z [2024-02-23 01:40:03,642: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:40:03.647146714Z [2024-02-23 01:40:03,646: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:40:03.647343263Z [2024-02-23 01:40:03,647: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:40:03.647583280Z [2024-02-23 01:40:03,647: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:40:03.647658949Z [2024-02-23 01:40:03,647: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T01:40:03.648103737Z [2024-02-23 01:40:03,647: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:40:03.648221940Z [2024-02-23 01:40:03,648: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:40:03.786002072Z [2024-02-23 01:40:03,785: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:03.872004252Z [2024-02-23 01:40:03,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18aa6004-49ac-4876-ba0f-fc90f4732dbd] succeeded in 2.562959939999928s: None 2024-02-23T01:40:04.068909301Z [2024-02-23 01:40:04,068: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:40:04.069000049Z [2024-02-23 01:40:04,068: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:40:04.072325297Z [2024-02-23 01:40:04,071: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:04.072850117Z [2024-02-23 01:40:04,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:04.104321036Z [2024-02-23 01:40:04,104: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:40:04.106548934Z [2024-02-23 01:40:04,106: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:40:04.106610505Z [2024-02-23 01:40:04,106: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:40:04.106937494Z [2024-02-23 01:40:04,106: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:40:04.106950816Z [2024-02-23 01:40:04,106: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:40:04.107251375Z [2024-02-23 01:40:04,107: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:40:04.107356684Z [2024-02-23 01:40:04,107: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:40:04.107449130Z [2024-02-23 01:40:04,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:40:04.109155840Z [2024-02-23 01:40:04,108: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:40:04.109418773Z [2024-02-23 01:40:04,109: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:40:04.109637601Z [2024-02-23 01:40:04,109: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:40:04.109860156Z [2024-02-23 01:40:04,109: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:40:04.110291476Z [2024-02-23 01:40:04,110: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:40:04.110362637Z [2024-02-23 01:40:04,110: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:40:04.204414670Z [2024-02-23 01:40:04,204: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:04.207701671Z [2024-02-23 01:40:04,207: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:04.948083974Z [2024-02-23 01:40:04,947: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc369230-a14f-43fb-8b0d-fd7f7577b016] succeeded in 3.654294267000296s: None 2024-02-23T01:40:05.088064966Z [2024-02-23 01:40:05,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02cdf73f-be25-4b97-a442-cbc740ba17e6] received 2024-02-23T01:40:05.103664724Z [2024-02-23 01:40:05,103: INFO/ForkPoolWorker-15] [02cdf73f-be25-4b97-a442-cbc740ba17e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:40:05.413320411Z [2024-02-23 01:40:05,410: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:40:05.558436923Z [2024-02-23 01:40:05,558: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c5f47e12-e9f2-49a9-bb51-0c0c921e6128] succeeded in 4.1996279310005775s: None 2024-02-23T01:40:06.537704950Z [2024-02-23 01:40:06,537: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:40:06.540882441Z [2024-02-23 01:40:06,540: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:06.562797216Z [2024-02-23 01:40:06,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:40:06.564096858Z [2024-02-23 01:40:06,563: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:40:06.564139196Z [2024-02-23 01:40:06,564: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:40:06.564290316Z [2024-02-23 01:40:06,564: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:40:06.564375766Z [2024-02-23 01:40:06,564: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:40:06.564624762Z [2024-02-23 01:40:06,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:40:06.564691237Z [2024-02-23 01:40:06,564: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:40:06.647590776Z [2024-02-23 01:40:06,647: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:07.278150399Z [2024-02-23 01:40:07,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02cdf73f-be25-4b97-a442-cbc740ba17e6] succeeded in 2.1878878610004904s: None 2024-02-23T01:40:07.315528293Z [2024-02-23 01:40:07,314: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0f912c68-23c3-44c2-9664-15f8331cb3a3] succeeded in 5.963095393999538s: None 2024-02-23T01:40:08.191923747Z [2024-02-23 01:40:08,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c021f15e-87bb-4b0d-881a-a0e988a6ed36] received 2024-02-23T01:40:08.201596225Z [2024-02-23 01:40:08,201: INFO/ForkPoolWorker-15] [c021f15e-87bb-4b0d-881a-a0e988a6ed36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:40:08.579160045Z [2024-02-23 01:40:08,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:40:09.741032518Z [2024-02-23 01:40:09,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:40:09.747400536Z [2024-02-23 01:40:09,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:09.780441717Z [2024-02-23 01:40:09,779: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:40:09.789429540Z [2024-02-23 01:40:09,781: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:40:09.789454136Z [2024-02-23 01:40:09,781: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:40:09.789460746Z [2024-02-23 01:40:09,781: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:40:09.789466124Z [2024-02-23 01:40:09,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:40:09.789469821Z [2024-02-23 01:40:09,781: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:40:09.789473551Z [2024-02-23 01:40:09,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:40:09.876439944Z [2024-02-23 01:40:09,876: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:10.547443550Z [2024-02-23 01:40:10,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c021f15e-87bb-4b0d-881a-a0e988a6ed36] succeeded in 2.353879180000149s: None 2024-02-23T01:40:10.579226920Z [2024-02-23 01:40:10,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdad2378-6485-413e-b265-573724769df8] received 2024-02-23T01:40:10.589807832Z [2024-02-23 01:40:10,589: INFO/ForkPoolWorker-15] [fdad2378-6485-413e-b265-573724769df8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:40:10.909919224Z [2024-02-23 01:40:10,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:40:12.059964524Z [2024-02-23 01:40:12,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:40:12.063661409Z [2024-02-23 01:40:12,063: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:40:12.095295364Z [2024-02-23 01:40:12,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:40:12.096840449Z [2024-02-23 01:40:12,096: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:40:12.096859410Z [2024-02-23 01:40:12,096: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:40:12.096999941Z [2024-02-23 01:40:12,096: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:40:12.097040800Z [2024-02-23 01:40:12,096: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:40:12.097278091Z [2024-02-23 01:40:12,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:40:12.097319533Z [2024-02-23 01:40:12,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:40:12.192243766Z [2024-02-23 01:40:12,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:40:12.857976027Z [2024-02-23 01:40:12,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdad2378-6485-413e-b265-573724769df8] succeeded in 2.273846128000514s: None 2024-02-23T01:41:01.212655997Z [2024-02-23 01:41:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6b1cf3b-e841-4bba-892b-ff3753dd9ee9] received 2024-02-23T01:41:01.218993017Z [2024-02-23 01:41:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f0b3d30-7671-4730-b39e-b76a6b590a85] received 2024-02-23T01:41:01.219485784Z [2024-02-23 01:41:01,219: INFO/ForkPoolWorker-15] [a6b1cf3b-e841-4bba-892b-ff3753dd9ee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:41:01.226086013Z [2024-02-23 01:41:01,225: INFO/ForkPoolWorker-16] [2f0b3d30-7671-4730-b39e-b76a6b590a85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:41:01.232745941Z [2024-02-23 01:41:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[538e5749-45c2-4a8c-8d80-97f0d94c9d77] received 2024-02-23T01:41:01.252967024Z [2024-02-23 01:41:01,252: INFO/ForkPoolWorker-1] [538e5749-45c2-4a8c-8d80-97f0d94c9d77] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:41:01.527070412Z [2024-02-23 01:41:01,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:41:01.610444769Z [2024-02-23 01:41:01,607: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:41:01.625136469Z [2024-02-23 01:41:01,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:41:01.776532900Z [2024-02-23 01:41:01,776: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:41:01.780641116Z [2024-02-23 01:41:01,780: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:41:01.800987339Z [2024-02-23 01:41:01,800: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:41:01.802105181Z [2024-02-23 01:41:01,801: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:41:01.802227667Z [2024-02-23 01:41:01,802: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:41:01.802247086Z [2024-02-23 01:41:01,802: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:41:01.802939399Z [2024-02-23 01:41:01,802: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:41:01.914528495Z [2024-02-23 01:41:01,914: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:41:02.471441091Z [2024-02-23 01:41:02,471: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[538e5749-45c2-4a8c-8d80-97f0d94c9d77] succeeded in 1.231034025999179s: None 2024-02-23T01:41:02.682955678Z [2024-02-23 01:41:02,682: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:41:02.686381862Z [2024-02-23 01:41:02,685: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:41:02.709143407Z [2024-02-23 01:41:02,708: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:41:02.710380089Z [2024-02-23 01:41:02,710: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:41:02.710523203Z [2024-02-23 01:41:02,710: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:41:02.710700261Z [2024-02-23 01:41:02,710: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:41:02.710810694Z [2024-02-23 01:41:02,710: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:41:02.711383120Z [2024-02-23 01:41:02,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:41:02.711502555Z [2024-02-23 01:41:02,711: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:41:02.800600060Z [2024-02-23 01:41:02,800: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:41:02.998641609Z [2024-02-23 01:41:02,998: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:41:03.002288790Z [2024-02-23 01:41:03,001: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:41:03.028198661Z [2024-02-23 01:41:03,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:41:03.030467891Z [2024-02-23 01:41:03,030: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:41:03.030559663Z [2024-02-23 01:41:03,030: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:41:03.030738047Z [2024-02-23 01:41:03,030: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:41:03.030923865Z [2024-02-23 01:41:03,030: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:41:03.032037944Z [2024-02-23 01:41:03,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:41:03.032136914Z [2024-02-23 01:41:03,031: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:41:03.161969142Z [2024-02-23 01:41:03,161: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:41:04.599751009Z [2024-02-23 01:41:04,599: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f0b3d30-7671-4730-b39e-b76a6b590a85] succeeded in 3.3784103929992852s: None 2024-02-23T01:41:05.099227364Z [2024-02-23 01:41:05,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6b1cf3b-e841-4bba-892b-ff3753dd9ee9] succeeded in 3.8851220309989003s: None 2024-02-23T01:42:01.176103281Z [2024-02-23 01:42:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00a70484-62ce-4c69-8799-47e32bcaea2e] received 2024-02-23T01:42:01.183525937Z [2024-02-23 01:42:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0d94201-e4e9-44ee-b9d5-127e9d33a59b] received 2024-02-23T01:42:01.189140927Z [2024-02-23 01:42:01,188: INFO/ForkPoolWorker-15] [00a70484-62ce-4c69-8799-47e32bcaea2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:42:01.189358529Z [2024-02-23 01:42:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edb44dd8-af6d-49e8-b968-490621844297] received 2024-02-23T01:42:01.194446700Z [2024-02-23 01:42:01,194: INFO/ForkPoolWorker-16] [e0d94201-e4e9-44ee-b9d5-127e9d33a59b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:42:01.196500785Z [2024-02-23 01:42:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e351e77-184b-466a-be2e-ffd7edfaa2ac] received 2024-02-23T01:42:01.197458706Z [2024-02-23 01:42:01,197: INFO/ForkPoolWorker-1] [edb44dd8-af6d-49e8-b968-490621844297] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:42:01.213584627Z [2024-02-23 01:42:01,213: INFO/ForkPoolWorker-2] [7e351e77-184b-466a-be2e-ffd7edfaa2ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:42:01.537710702Z [2024-02-23 01:42:01,533: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:42:01.627670379Z [2024-02-23 01:42:01,624: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:42:01.628614303Z [2024-02-23 01:42:01,625: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:42:01.701695351Z [2024-02-23 01:42:01,698: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:42:01.788244295Z [2024-02-23 01:42:01,787: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:42:01.792164963Z [2024-02-23 01:42:01,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:42:01.849251207Z [2024-02-23 01:42:01,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:42:01.850754446Z [2024-02-23 01:42:01,850: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:42:01.851031057Z [2024-02-23 01:42:01,850: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:42:01.851234996Z [2024-02-23 01:42:01,851: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:42:01.851571854Z [2024-02-23 01:42:01,851: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:42:01.896138820Z [2024-02-23 01:42:01,895: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:42:01.975896696Z [2024-02-23 01:42:01,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:42:02.619542418Z [2024-02-23 01:42:02,619: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0d94201-e4e9-44ee-b9d5-127e9d33a59b] succeeded in 1.431200342000011s: None 2024-02-23T01:42:02.653188901Z [2024-02-23 01:42:02,652: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00a70484-62ce-4c69-8799-47e32bcaea2e] succeeded in 1.473527758000273s: None 2024-02-23T01:42:03.047219560Z [2024-02-23 01:42:03,046: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:42:03.050559409Z [2024-02-23 01:42:03,050: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:42:03.073783469Z [2024-02-23 01:42:03,073: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:42:03.075348206Z [2024-02-23 01:42:03,075: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:42:03.075466166Z [2024-02-23 01:42:03,075: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:42:03.075737532Z [2024-02-23 01:42:03,075: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:42:03.075869547Z [2024-02-23 01:42:03,075: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:42:03.076291756Z [2024-02-23 01:42:03,076: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:42:03.076405334Z [2024-02-23 01:42:03,076: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:42:03.089851032Z [2024-02-23 01:42:03,089: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:42:03.093377328Z [2024-02-23 01:42:03,092: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:42:03.123458425Z [2024-02-23 01:42:03,123: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:42:03.126944796Z [2024-02-23 01:42:03,126: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:42:03.127094667Z [2024-02-23 01:42:03,126: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:42:03.127307558Z [2024-02-23 01:42:03,127: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:42:03.127383290Z [2024-02-23 01:42:03,127: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:42:03.127768765Z [2024-02-23 01:42:03,127: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:42:03.127821845Z [2024-02-23 01:42:03,127: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:42:03.190171140Z [2024-02-23 01:42:03,189: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:42:03.223543889Z [2024-02-23 01:42:03,223: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:42:05.622563287Z [2024-02-23 01:42:05,622: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7e351e77-184b-466a-be2e-ffd7edfaa2ac] succeeded in 4.415205653000157s: None 2024-02-23T01:42:05.982559495Z [2024-02-23 01:42:05,981: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edb44dd8-af6d-49e8-b968-490621844297] succeeded in 4.789853201998994s: None 2024-02-23T01:43:01.070502368Z [2024-02-23 01:43:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2259e524-9f99-4fe5-8f39-5408b7f4d523] received 2024-02-23T01:43:01.074375904Z [2024-02-23 01:43:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd0a5e88-8083-431f-a9b6-85103c3afe64] received 2024-02-23T01:43:01.077468864Z [2024-02-23 01:43:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf91fdc-946e-4a4b-8b74-7e6b1283ab32] received 2024-02-23T01:43:01.087544475Z [2024-02-23 01:43:01,086: INFO/ForkPoolWorker-16] [cd0a5e88-8083-431f-a9b6-85103c3afe64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:43:01.087686167Z [2024-02-23 01:43:01,087: INFO/ForkPoolWorker-1] [eaf91fdc-946e-4a4b-8b74-7e6b1283ab32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:43:01.090850858Z [2024-02-23 01:43:01,086: INFO/ForkPoolWorker-15] [2259e524-9f99-4fe5-8f39-5408b7f4d523] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:43:01.391896325Z [2024-02-23 01:43:01,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:43:01.421920085Z [2024-02-23 01:43:01,418: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:43:01.481201030Z [2024-02-23 01:43:01,477: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:43:01.562675110Z [2024-02-23 01:43:01,562: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:43:01.566748310Z [2024-02-23 01:43:01,566: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:43:01.599885907Z [2024-02-23 01:43:01,599: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:43:01.603644361Z [2024-02-23 01:43:01,603: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:43:01.603671640Z [2024-02-23 01:43:01,603: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:43:01.603731867Z [2024-02-23 01:43:01,603: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:43:01.603921388Z [2024-02-23 01:43:01,603: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:43:01.711459051Z [2024-02-23 01:43:01,711: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:43:02.417698339Z [2024-02-23 01:43:02,417: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2259e524-9f99-4fe5-8f39-5408b7f4d523] succeeded in 1.345232035000663s: None 2024-02-23T01:43:02.888404255Z [2024-02-23 01:43:02,888: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:43:02.892073203Z [2024-02-23 01:43:02,891: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:43:02.915425533Z [2024-02-23 01:43:02,915: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:43:02.916977245Z [2024-02-23 01:43:02,916: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:43:02.917018450Z [2024-02-23 01:43:02,916: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:43:02.917299071Z [2024-02-23 01:43:02,916: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:43:02.917326556Z [2024-02-23 01:43:02,917: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:43:02.917606218Z [2024-02-23 01:43:02,917: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:43:02.917638922Z [2024-02-23 01:43:02,917: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:43:02.925919756Z [2024-02-23 01:43:02,925: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:43:02.929415426Z [2024-02-23 01:43:02,928: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:43:02.961578086Z [2024-02-23 01:43:02,961: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:43:02.967643478Z [2024-02-23 01:43:02,963: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:43:02.967839119Z [2024-02-23 01:43:02,967: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:43:02.968306905Z [2024-02-23 01:43:02,967: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:43:02.968681800Z [2024-02-23 01:43:02,968: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:43:02.969267090Z [2024-02-23 01:43:02,969: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:43:02.969428188Z [2024-02-23 01:43:02,969: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:43:03.021132144Z [2024-02-23 01:43:03,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:43:03.103632180Z [2024-02-23 01:43:03,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:43:04.800222210Z [2024-02-23 01:43:04,799: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eaf91fdc-946e-4a4b-8b74-7e6b1283ab32] succeeded in 3.7205773160003446s: None 2024-02-23T01:43:04.954789876Z [2024-02-23 01:43:04,954: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd0a5e88-8083-431f-a9b6-85103c3afe64] succeeded in 3.8770040390008944s: None 2024-02-23T01:44:00.983811671Z [2024-02-23 01:44:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5092ea96-ebc6-452f-bedd-d2d48369d3b6] received 2024-02-23T01:44:00.991296100Z [2024-02-23 01:44:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a8f34cf-fcc7-4462-9bea-ecddf82ef27f] received 2024-02-23T01:44:00.993957164Z [2024-02-23 01:44:00,993: INFO/ForkPoolWorker-15] [5092ea96-ebc6-452f-bedd-d2d48369d3b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:44:00.999144759Z [2024-02-23 01:44:00,998: INFO/ForkPoolWorker-16] [8a8f34cf-fcc7-4462-9bea-ecddf82ef27f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:44:01.000804771Z [2024-02-23 01:44:01,000: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4661824-4942-4d3c-9e12-785b43fedf66] received 2024-02-23T01:44:01.004188571Z [2024-02-23 01:44:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da098b76-3abb-4d00-a931-123fe06a6cda] received 2024-02-23T01:44:01.009821566Z [2024-02-23 01:44:01,009: INFO/ForkPoolWorker-1] [a4661824-4942-4d3c-9e12-785b43fedf66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:44:01.010197017Z [2024-02-23 01:44:01,010: INFO/ForkPoolWorker-2] [da098b76-3abb-4d00-a931-123fe06a6cda] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:44:01.315772649Z [2024-02-23 01:44:01,312: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:44:01.372607259Z [2024-02-23 01:44:01,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:44:01.393711733Z [2024-02-23 01:44:01,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:44:01.429027912Z [2024-02-23 01:44:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:44:01.473647697Z [2024-02-23 01:44:01,473: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:44:01.478606451Z [2024-02-23 01:44:01,478: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:44:01.496662786Z [2024-02-23 01:44:01,496: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:44:01.497573944Z [2024-02-23 01:44:01,497: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:44:01.497629861Z [2024-02-23 01:44:01,497: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:44:01.497678900Z [2024-02-23 01:44:01,497: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:44:01.497841901Z [2024-02-23 01:44:01,497: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:44:01.604944228Z [2024-02-23 01:44:01,604: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:44:01.705675793Z [2024-02-23 01:44:01,705: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:44:02.385945077Z [2024-02-23 01:44:02,385: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5092ea96-ebc6-452f-bedd-d2d48369d3b6] succeeded in 1.4002320300005522s: None 2024-02-23T01:44:02.465476855Z [2024-02-23 01:44:02,464: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[da098b76-3abb-4d00-a931-123fe06a6cda] succeeded in 1.4594359120001172s: None 2024-02-23T01:44:02.852620458Z [2024-02-23 01:44:02,852: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:44:02.856799849Z [2024-02-23 01:44:02,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:44:02.879895737Z [2024-02-23 01:44:02,879: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:44:02.881483708Z [2024-02-23 01:44:02,881: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:44:02.881641259Z [2024-02-23 01:44:02,881: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:44:02.881839932Z [2024-02-23 01:44:02,881: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:44:02.881977816Z [2024-02-23 01:44:02,881: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:44:02.882342969Z [2024-02-23 01:44:02,882: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:44:02.882502742Z [2024-02-23 01:44:02,882: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:44:02.997988897Z [2024-02-23 01:44:02,997: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:44:03.001038733Z [2024-02-23 01:44:03,000: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:44:03.001278907Z [2024-02-23 01:44:03,000: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:44:03.029684768Z [2024-02-23 01:44:03,029: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:44:03.031948052Z [2024-02-23 01:44:03,031: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:44:03.031988880Z [2024-02-23 01:44:03,031: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:44:03.032568303Z [2024-02-23 01:44:03,031: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:44:03.032692121Z [2024-02-23 01:44:03,032: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:44:03.032970836Z [2024-02-23 01:44:03,032: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:44:03.033016004Z [2024-02-23 01:44:03,032: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:44:03.132903997Z [2024-02-23 01:44:03,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:44:05.180740512Z [2024-02-23 01:44:05,180: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a8f34cf-fcc7-4462-9bea-ecddf82ef27f] succeeded in 4.188183890999426s: None 2024-02-23T01:44:06.070730138Z [2024-02-23 01:44:06,070: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4661824-4942-4d3c-9e12-785b43fedf66] succeeded in 5.065536419000637s: None 2024-02-23T01:44:50.283584422Z [2024-02-23 01:44:50,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f8437e1-0f48-43ad-b8d0-7038636c444e] received 2024-02-23T01:44:50.291254753Z [2024-02-23 01:44:50,290: INFO/ForkPoolWorker-15] [8f8437e1-0f48-43ad-b8d0-7038636c444e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:44:50.574533095Z [2024-02-23 01:44:50,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:44:50.719390708Z [2024-02-23 01:44:50,718: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:44:50.722948761Z [2024-02-23 01:44:50,722: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:44:50.778259296Z [2024-02-23 01:44:50,777: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:44:50.779218736Z [2024-02-23 01:44:50,779: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:44:50.779240703Z [2024-02-23 01:44:50,779: INFO/ForkPoolWorker-15] Read SDNC 401f080d-d0a7-4e0f-996d-20269f36c499 (epa_03) 2024-02-23T01:44:50.779406912Z [2024-02-23 01:44:50,779: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '401f080d-d0a7-4e0f-996d-20269f36c499', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-02-23T01:44:50.779469983Z [2024-02-23 01:44:50,779: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:44:50.779811148Z [2024-02-23 01:44:50,779: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:44:50.785808521Z [2024-02-23 01:44:50,785: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499 2024-02-23T01:44:50.893620085Z [2024-02-23 01:44:50,893: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:44:51.481707633Z [2024-02-23 01:44:51,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f8437e1-0f48-43ad-b8d0-7038636c444e] succeeded in 1.1965890920000675s: None 2024-02-23T01:45:00.553126177Z [2024-02-23 01:45:00,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa74cd24-ab30-406d-80d9-7f8f38d4aa36] received 2024-02-23T01:45:00.555707761Z [2024-02-23 01:45:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5108bad-e7f4-47ab-9ddf-a058c4ef52ce] received 2024-02-23T01:45:00.563268417Z [2024-02-23 01:45:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cae631b-dae6-447f-887e-e62e9b66feb0] received 2024-02-23T01:45:00.565682782Z [2024-02-23 01:45:00,565: INFO/ForkPoolWorker-16] [a5108bad-e7f4-47ab-9ddf-a058c4ef52ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:45:00.567132503Z [2024-02-23 01:45:00,566: INFO/ForkPoolWorker-15] [fa74cd24-ab30-406d-80d9-7f8f38d4aa36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:45:00.570860922Z [2024-02-23 01:45:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f06e7b83-ac13-4963-abf3-259414a74639] received 2024-02-23T01:45:00.576671396Z [2024-02-23 01:45:00,576: INFO/ForkPoolWorker-2] [f06e7b83-ac13-4963-abf3-259414a74639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:45:00.577444262Z [2024-02-23 01:45:00,577: INFO/ForkPoolWorker-1] [3cae631b-dae6-447f-887e-e62e9b66feb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:45:00.590253086Z [2024-02-23 01:45:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50415659-8fcc-473a-b7f1-65fa82092151] received 2024-02-23T01:45:00.606533017Z [2024-02-23 01:45:00,606: INFO/ForkPoolWorker-3] [50415659-8fcc-473a-b7f1-65fa82092151] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:45:01.064708411Z [2024-02-23 01:45:01,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:45:01.120473681Z [2024-02-23 01:45:01,117: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:45:01.138218516Z [2024-02-23 01:45:01,132: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:45:01.239618719Z [2024-02-23 01:45:01,236: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:45:01.372141619Z [2024-02-23 01:45:01,371: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T01:45:01.380322463Z [2024-02-23 01:45:01,379: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:01.390663839Z [2024-02-23 01:45:01,380: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:45:01.456188594Z [2024-02-23 01:45:01,455: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:45:01.457965781Z [2024-02-23 01:45:01,457: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:45:01.458178419Z [2024-02-23 01:45:01,457: INFO/ForkPoolWorker-3] Read SDNC 401f080d-d0a7-4e0f-996d-20269f36c499 (epa_03) 2024-02-23T01:45:01.458403379Z [2024-02-23 01:45:01,458: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '401f080d-d0a7-4e0f-996d-20269f36c499', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-02-23T01:45:01.458551770Z [2024-02-23 01:45:01,458: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T01:45:01.458853708Z [2024-02-23 01:45:01,458: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:45:01.466037442Z [2024-02-23 01:45:01,465: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499 2024-02-23T01:45:01.657289424Z [2024-02-23 01:45:01,657: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:01.806595460Z [2024-02-23 01:45:01,805: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:45:01.811388188Z [2024-02-23 01:45:01,810: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:01.864957612Z [2024-02-23 01:45:01,864: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:45:01.867751843Z [2024-02-23 01:45:01,867: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:45:01.867837250Z [2024-02-23 01:45:01,867: INFO/ForkPoolWorker-1] Read SDNC 401f080d-d0a7-4e0f-996d-20269f36c499 (epa_03) 2024-02-23T01:45:01.868000469Z [2024-02-23 01:45:01,867: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '401f080d-d0a7-4e0f-996d-20269f36c499', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-02-23T01:45:01.868068555Z [2024-02-23 01:45:01,867: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:45:01.868299808Z [2024-02-23 01:45:01,868: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:45:01.875249340Z [2024-02-23 01:45:01,875: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499 2024-02-23T01:45:02.013479248Z [2024-02-23 01:45:02,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:02.509785430Z [2024-02-23 01:45:02,509: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[50415659-8fcc-473a-b7f1-65fa82092151] succeeded in 1.9165489070001058s: None 2024-02-23T01:45:02.705993333Z [2024-02-23 01:45:02,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cae631b-dae6-447f-887e-e62e9b66feb0] succeeded in 2.140238825000779s: None 2024-02-23T01:45:03.057108348Z [2024-02-23 01:45:03,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:45:03.068181979Z [2024-02-23 01:45:03,067: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:03.102162469Z [2024-02-23 01:45:03,101: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:45:03.109480593Z [2024-02-23 01:45:03,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:45:03.111103834Z [2024-02-23 01:45:03,110: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:45:03.111166131Z [2024-02-23 01:45:03,111: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:45:03.111359863Z [2024-02-23 01:45:03,111: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:45:03.111500871Z [2024-02-23 01:45:03,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:45:03.112146968Z [2024-02-23 01:45:03,111: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:45:03.112458430Z [2024-02-23 01:45:03,112: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:45:03.113553582Z [2024-02-23 01:45:03,112: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:03.153887887Z [2024-02-23 01:45:03,153: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:45:03.157021086Z [2024-02-23 01:45:03,156: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:45:03.157265976Z [2024-02-23 01:45:03,157: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:45:03.157521255Z [2024-02-23 01:45:03,157: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:45:03.157674000Z [2024-02-23 01:45:03,157: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:45:03.158093189Z [2024-02-23 01:45:03,157: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:45:03.158703988Z [2024-02-23 01:45:03,158: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:45:03.210121851Z [2024-02-23 01:45:03,209: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:03.243308097Z [2024-02-23 01:45:03,242: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:03.252325628Z [2024-02-23 01:45:03,251: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:45:03.256385731Z [2024-02-23 01:45:03,255: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:03.279405919Z [2024-02-23 01:45:03,279: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:45:03.281595628Z [2024-02-23 01:45:03,281: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:45:03.281631247Z [2024-02-23 01:45:03,281: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:45:03.283226667Z [2024-02-23 01:45:03,282: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:45:03.283240556Z [2024-02-23 01:45:03,283: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:45:03.283975552Z [2024-02-23 01:45:03,283: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:45:03.284383440Z [2024-02-23 01:45:03,283: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:45:03.376667597Z [2024-02-23 01:45:03,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:03.796227462Z [2024-02-23 01:45:03,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa74cd24-ab30-406d-80d9-7f8f38d4aa36] succeeded in 3.236532877999707s: None 2024-02-23T01:45:04.717026229Z [2024-02-23 01:45:04,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e4826d9-0211-4ed9-abbf-ed7b1cd83111] received 2024-02-23T01:45:04.731031672Z [2024-02-23 01:45:04,729: INFO/ForkPoolWorker-15] [1e4826d9-0211-4ed9-abbf-ed7b1cd83111] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:45:04.953261923Z [2024-02-23 01:45:04,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a5108bad-e7f4-47ab-9ddf-a058c4ef52ce] succeeded in 4.395304723999288s: None 2024-02-23T01:45:05.059049778Z [2024-02-23 01:45:05,056: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:45:05.188341178Z [2024-02-23 01:45:05,187: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f06e7b83-ac13-4963-abf3-259414a74639] succeeded in 4.616041887000392s: None 2024-02-23T01:45:06.160552411Z [2024-02-23 01:45:06,160: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:45:06.163674129Z [2024-02-23 01:45:06,163: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:06.182638922Z [2024-02-23 01:45:06,182: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:45:06.184467775Z [2024-02-23 01:45:06,184: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:45:06.184486726Z [2024-02-23 01:45:06,184: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:45:06.184566032Z [2024-02-23 01:45:06,184: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:45:06.184620954Z [2024-02-23 01:45:06,184: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:45:06.184847601Z [2024-02-23 01:45:06,184: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:45:06.184903899Z [2024-02-23 01:45:06,184: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:45:06.269229625Z [2024-02-23 01:45:06,268: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:06.863275504Z [2024-02-23 01:45:06,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e4826d9-0211-4ed9-abbf-ed7b1cd83111] succeeded in 2.155513591000272s: None 2024-02-23T01:45:07.108613958Z [2024-02-23 01:45:07,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[373ef41a-af23-41fa-a724-8a833883153e] received 2024-02-23T01:45:07.118674467Z [2024-02-23 01:45:07,118: INFO/ForkPoolWorker-15] [373ef41a-af23-41fa-a724-8a833883153e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:45:07.401994331Z [2024-02-23 01:45:07,399: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:45:08.515099368Z [2024-02-23 01:45:08,514: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:45:08.518478787Z [2024-02-23 01:45:08,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:08.540641230Z [2024-02-23 01:45:08,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:45:08.543210641Z [2024-02-23 01:45:08,542: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:45:08.543252519Z [2024-02-23 01:45:08,543: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:45:08.543349018Z [2024-02-23 01:45:08,543: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:45:08.543470255Z [2024-02-23 01:45:08,543: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:45:08.543745880Z [2024-02-23 01:45:08,543: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:45:08.543883165Z [2024-02-23 01:45:08,543: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:45:08.646020957Z [2024-02-23 01:45:08,645: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:09.195055387Z [2024-02-23 01:45:09,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[373ef41a-af23-41fa-a724-8a833883153e] succeeded in 2.083877245999247s: None 2024-02-23T01:45:09.656076027Z [2024-02-23 01:45:09,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59190298-4a38-4537-844c-a6a1f02f48f2] received 2024-02-23T01:45:09.665686977Z [2024-02-23 01:45:09,665: INFO/ForkPoolWorker-15] [59190298-4a38-4537-844c-a6a1f02f48f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:45:09.936334879Z [2024-02-23 01:45:09,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:45:11.004357381Z [2024-02-23 01:45:11,003: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:45:11.007506090Z [2024-02-23 01:45:11,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:45:11.024756164Z [2024-02-23 01:45:11,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:45:11.025979383Z [2024-02-23 01:45:11,025: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:45:11.026101553Z [2024-02-23 01:45:11,025: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:45:11.026279743Z [2024-02-23 01:45:11,026: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:45:11.026363943Z [2024-02-23 01:45:11,026: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:45:11.026626973Z [2024-02-23 01:45:11,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:45:11.026759278Z [2024-02-23 01:45:11,026: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:45:11.113218251Z [2024-02-23 01:45:11,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:45:11.665826604Z [2024-02-23 01:45:11,665: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59190298-4a38-4537-844c-a6a1f02f48f2] succeeded in 2.007101999999577s: None 2024-02-23T01:46:00.445492463Z [2024-02-23 01:46:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7db7e11-ec97-4ed0-81d0-49aef24bc04e] received 2024-02-23T01:46:00.447174871Z [2024-02-23 01:46:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3f744dc-405d-4a1b-9b83-b641680bb809] received 2024-02-23T01:46:00.451042066Z [2024-02-23 01:46:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50405c1d-ddca-4d5c-8588-e71e59c1694e] received 2024-02-23T01:46:00.455387236Z [2024-02-23 01:46:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53cb433f-752a-4d48-9c9b-6b1efffc85f3] received 2024-02-23T01:46:00.456392593Z [2024-02-23 01:46:00,456: INFO/ForkPoolWorker-15] [b7db7e11-ec97-4ed0-81d0-49aef24bc04e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:46:00.459386213Z [2024-02-23 01:46:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2a6e154-03f6-4544-b8e3-dc68798106d5] received 2024-02-23T01:46:00.459706366Z [2024-02-23 01:46:00,459: INFO/ForkPoolWorker-16] [f3f744dc-405d-4a1b-9b83-b641680bb809] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:46:00.470042119Z [2024-02-23 01:46:00,469: INFO/ForkPoolWorker-3] [e2a6e154-03f6-4544-b8e3-dc68798106d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:46:00.470675531Z [2024-02-23 01:46:00,470: INFO/ForkPoolWorker-2] [53cb433f-752a-4d48-9c9b-6b1efffc85f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:46:00.478418491Z [2024-02-23 01:46:00,478: INFO/ForkPoolWorker-1] [50405c1d-ddca-4d5c-8588-e71e59c1694e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:46:00.889630645Z [2024-02-23 01:46:00,879: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:46:00.895351704Z [2024-02-23 01:46:00,886: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:46:00.982118659Z [2024-02-23 01:46:00,978: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:01.002564371Z [2024-02-23 01:46:00,999: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:01.015084665Z [2024-02-23 01:46:01,011: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:46:01.143314454Z [2024-02-23 01:46:01,142: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:46:01.147108866Z [2024-02-23 01:46:01,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:01.191893862Z [2024-02-23 01:46:01,191: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:46:01.193752108Z [2024-02-23 01:46:01,193: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:46:01.193990650Z [2024-02-23 01:46:01,193: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:46:01.194162897Z [2024-02-23 01:46:01,194: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:46:01.194497312Z [2024-02-23 01:46:01,194: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:46:01.297574652Z [2024-02-23 01:46:01,297: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:46:01.428832783Z [2024-02-23 01:46:01,428: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T01:46:01.432764292Z [2024-02-23 01:46:01,432: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:01.457495085Z [2024-02-23 01:46:01,457: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:46:01.459886896Z [2024-02-23 01:46:01,459: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:46:01.463760164Z [2024-02-23 01:46:01,463: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:46:01.463941286Z [2024-02-23 01:46:01,463: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:46:01.464087224Z [2024-02-23 01:46:01,463: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T01:46:01.464379485Z [2024-02-23 01:46:01,464: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:46:01.473244987Z [2024-02-23 01:46:01,473: WARNING/ForkPoolWorker-3] Dag 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:01.473715885Z [2024-02-23 01:46:01,473: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:01.476141765Z [2024-02-23 01:46:01,475: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T01:46:01.478882970Z [2024-02-23 01:46:01,478: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:01.524527595Z [2024-02-23 01:46:01,524: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:46:01.527651886Z [2024-02-23 01:46:01,527: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:46:01.527857280Z [2024-02-23 01:46:01,527: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:46:01.528045859Z [2024-02-23 01:46:01,527: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T01:46:01.528324533Z [2024-02-23 01:46:01,528: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:46:01.532727174Z [2024-02-23 01:46:01,532: ERROR/ForkPoolWorker-3] [e2a6e154-03f6-4544-b8e3-dc68798106d5] Failed to execute task Dag 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499' could not be found; either it does not exist or it failed to parse.. 2024-02-23T01:46:01.532743336Z Traceback (most recent call last): 2024-02-23T01:46:01.532747412Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T01:46:01.532751960Z args.func(args) 2024-02-23T01:46:01.532755982Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T01:46:01.532766052Z return func(*args, **kwargs) 2024-02-23T01:46:01.532769503Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T01:46:01.532772811Z return f(*args, **kwargs) 2024-02-23T01:46:01.532776066Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T01:46:01.532779596Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T01:46:01.532783306Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T01:46:01.532786610Z raise AirflowException( 2024-02-23T01:46:01.532790553Z airflow.exceptions.AirflowException: Dag 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499' could not be found; either it does not exist or it failed to parse. 2024-02-23T01:46:01.576712347Z [2024-02-23 01:46:01,575: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e2a6e154-03f6-4544-b8e3-dc68798106d5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e2a6e154-03f6-4544-b8e3-dc68798106d5') 2024-02-23T01:46:01.576754288Z Traceback (most recent call last): 2024-02-23T01:46:01.576760531Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T01:46:01.576764973Z R = retval = fun(*args, **kwargs) 2024-02-23T01:46:01.576769135Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T01:46:01.576773371Z return self.run(*args, **kwargs) 2024-02-23T01:46:01.576779785Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T01:46:01.576784687Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T01:46:01.576789364Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T01:46:01.576795099Z raise AirflowException(msg) 2024-02-23T01:46:01.576800236Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e2a6e154-03f6-4544-b8e3-dc68798106d5 2024-02-23T01:46:02.342730419Z [2024-02-23 01:46:02,341: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3f744dc-405d-4a1b-9b83-b641680bb809] succeeded in 1.893591304000438s: None 2024-02-23T01:46:02.351400386Z [2024-02-23 01:46:02,350: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[53cb433f-752a-4d48-9c9b-6b1efffc85f3] succeeded in 1.893629158999829s: None 2024-02-23T01:46:02.514674352Z [2024-02-23 01:46:02,514: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:46:02.518106723Z [2024-02-23 01:46:02,517: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:02.542524943Z [2024-02-23 01:46:02,542: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:46:02.545267681Z [2024-02-23 01:46:02,544: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:46:02.545282993Z [2024-02-23 01:46:02,545: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:46:02.545605476Z [2024-02-23 01:46:02,545: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:46:02.545735449Z [2024-02-23 01:46:02,545: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:46:02.546379867Z [2024-02-23 01:46:02,546: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:46:02.546436324Z [2024-02-23 01:46:02,546: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:46:02.636639514Z [2024-02-23 01:46:02,636: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:46:02.708936166Z [2024-02-23 01:46:02,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:46:02.712101071Z [2024-02-23 01:46:02,711: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:02.731444832Z [2024-02-23 01:46:02,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:46:02.732133193Z [2024-02-23 01:46:02,731: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:46:02.732151442Z [2024-02-23 01:46:02,732: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:46:02.732257514Z [2024-02-23 01:46:02,732: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:46:02.732285986Z [2024-02-23 01:46:02,732: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:46:02.732500445Z [2024-02-23 01:46:02,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:46:02.732512307Z [2024-02-23 01:46:02,732: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:46:02.817586529Z [2024-02-23 01:46:02,817: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:46:04.536967464Z [2024-02-23 01:46:04,536: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50405c1d-ddca-4d5c-8588-e71e59c1694e] succeeded in 4.082928309999261s: None 2024-02-23T01:46:04.855736230Z [2024-02-23 01:46:04,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7db7e11-ec97-4ed0-81d0-49aef24bc04e] succeeded in 4.407624349998514s: None 2024-02-23T01:46:12.703305490Z [2024-02-23 01:46:12,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdba04bd-ca1f-4b86-808b-cc995155b26f] received 2024-02-23T01:46:12.709919840Z [2024-02-23 01:46:12,709: INFO/ForkPoolWorker-15] [bdba04bd-ca1f-4b86-808b-cc995155b26f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:46:12.989522962Z [2024-02-23 01:46:12,985: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:13.157954606Z [2024-02-23 01:46:13,157: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:46:13.162240889Z [2024-02-23 01:46:13,161: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:13.189575623Z [2024-02-23 01:46:13,189: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:46:13.191526369Z [2024-02-23 01:46:13,191: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:46:13.191979054Z [2024-02-23 01:46:13,191: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:46:13.192259259Z [2024-02-23 01:46:13,191: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:46:13.192983268Z [2024-02-23 01:46:13,192: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:46:13.205523102Z [2024-02-23 01:46:13,205: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:13.205976304Z [2024-02-23 01:46:13,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:46:13.207402625Z [2024-02-23 01:46:13,207: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:46:13.212786236Z [2024-02-23 01:46:13,212: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:46:13.231178239Z [2024-02-23 01:46:13,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:46:13.232606762Z [2024-02-23 01:46:13,232: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:46:13.232923903Z [2024-02-23 01:46:13,232: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:46:13.233123329Z [2024-02-23 01:46:13,232: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:46:13.233462730Z [2024-02-23 01:46:13,233: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:46:13.238383245Z [2024-02-23 01:46:13,237: ERROR/ForkPoolWorker-15] [bdba04bd-ca1f-4b86-808b-cc995155b26f] Failed to execute task Dag 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499' could not be found; either it does not exist or it failed to parse.. 2024-02-23T01:46:13.238406384Z Traceback (most recent call last): 2024-02-23T01:46:13.238415195Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T01:46:13.238423091Z args.func(args) 2024-02-23T01:46:13.238430643Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T01:46:13.238440236Z return func(*args, **kwargs) 2024-02-23T01:46:13.238447895Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T01:46:13.238454775Z return f(*args, **kwargs) 2024-02-23T01:46:13.238462004Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T01:46:13.238467894Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T01:46:13.238472672Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T01:46:13.238477550Z raise AirflowException( 2024-02-23T01:46:13.238487254Z airflow.exceptions.AirflowException: Dag 'sdnc_status_401f080d-d0a7-4e0f-996d-20269f36c499' could not be found; either it does not exist or it failed to parse. 2024-02-23T01:46:13.261340375Z [2024-02-23 01:46:13,260: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bdba04bd-ca1f-4b86-808b-cc995155b26f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bdba04bd-ca1f-4b86-808b-cc995155b26f') 2024-02-23T01:46:13.261358631Z Traceback (most recent call last): 2024-02-23T01:46:13.261362732Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T01:46:13.261366089Z R = retval = fun(*args, **kwargs) 2024-02-23T01:46:13.261379931Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T01:46:13.261383226Z return self.run(*args, **kwargs) 2024-02-23T01:46:13.261387876Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T01:46:13.261392553Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T01:46:13.261395747Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T01:46:13.261400304Z raise AirflowException(msg) 2024-02-23T01:46:13.261404069Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bdba04bd-ca1f-4b86-808b-cc995155b26f 2024-02-23T01:47:00.380472812Z [2024-02-23 01:47:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[752eed57-fea2-49e0-a15d-e5e11e410c12] received 2024-02-23T01:47:00.384344526Z [2024-02-23 01:47:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[671bc00a-c8e6-41cf-bed0-534e5d7bf256] received 2024-02-23T01:47:00.391940852Z [2024-02-23 01:47:00,391: INFO/ForkPoolWorker-15] [752eed57-fea2-49e0-a15d-e5e11e410c12] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:47:00.398879646Z [2024-02-23 01:47:00,398: INFO/ForkPoolWorker-16] [671bc00a-c8e6-41cf-bed0-534e5d7bf256] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:47:00.399251413Z [2024-02-23 01:47:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9284ae89-ee1e-4c87-8cac-d7b389edfd49] received 2024-02-23T01:47:00.406571695Z [2024-02-23 01:47:00,406: INFO/ForkPoolWorker-1] [9284ae89-ee1e-4c87-8cac-d7b389edfd49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:47:00.709215723Z [2024-02-23 01:47:00,706: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:47:00.721503379Z [2024-02-23 01:47:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:47:00.731652191Z [2024-02-23 01:47:00,728: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:47:00.869764781Z [2024-02-23 01:47:00,869: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:47:00.873527939Z [2024-02-23 01:47:00,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:47:00.895289180Z [2024-02-23 01:47:00,895: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:47:00.896814032Z [2024-02-23 01:47:00,896: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:47:00.897026655Z [2024-02-23 01:47:00,896: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:47:00.897197104Z [2024-02-23 01:47:00,897: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:47:00.897572181Z [2024-02-23 01:47:00,897: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:47:00.979313866Z [2024-02-23 01:47:00,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:47:01.585439964Z [2024-02-23 01:47:01,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[752eed57-fea2-49e0-a15d-e5e11e410c12] succeeded in 1.1999090619992785s: None 2024-02-23T01:47:01.912613443Z [2024-02-23 01:47:01,912: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:47:01.916111347Z [2024-02-23 01:47:01,915: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:47:01.935713415Z [2024-02-23 01:47:01,935: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:47:01.937079398Z [2024-02-23 01:47:01,936: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:47:01.937195657Z [2024-02-23 01:47:01,937: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:47:01.937376932Z [2024-02-23 01:47:01,937: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:47:01.937430036Z [2024-02-23 01:47:01,937: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:47:01.937728370Z [2024-02-23 01:47:01,937: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:47:01.937839076Z [2024-02-23 01:47:01,937: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:47:02.016101124Z [2024-02-23 01:47:02,015: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:47:02.019722317Z [2024-02-23 01:47:02,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:47:02.023751915Z [2024-02-23 01:47:02,023: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:47:02.046906047Z [2024-02-23 01:47:02,046: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:47:02.051630570Z [2024-02-23 01:47:02,051: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:47:02.051816126Z [2024-02-23 01:47:02,051: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:47:02.052089788Z [2024-02-23 01:47:02,051: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:47:02.052246859Z [2024-02-23 01:47:02,052: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:47:02.052551182Z [2024-02-23 01:47:02,052: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:47:02.052785849Z [2024-02-23 01:47:02,052: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:47:02.137371696Z [2024-02-23 01:47:02,137: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:47:03.837478061Z [2024-02-23 01:47:03,836: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9284ae89-ee1e-4c87-8cac-d7b389edfd49] succeeded in 3.4355437610010995s: None 2024-02-23T01:47:04.061648682Z [2024-02-23 01:47:04,061: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[671bc00a-c8e6-41cf-bed0-534e5d7bf256] succeeded in 3.6724576659999s: None 2024-02-23T01:48:00.278388003Z [2024-02-23 01:48:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bc3be61-f4b3-4817-9f94-55de5a850645] received 2024-02-23T01:48:00.282237048Z [2024-02-23 01:48:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8583b78-5a62-46e7-9ef3-c6552148b151] received 2024-02-23T01:48:00.287393386Z [2024-02-23 01:48:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f88d6c61-a955-4307-9d85-ba2ab5f95b1b] received 2024-02-23T01:48:00.290818765Z [2024-02-23 01:48:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20420572-d2f6-46b6-9710-8b68d16999e6] received 2024-02-23T01:48:00.292294451Z [2024-02-23 01:48:00,292: INFO/ForkPoolWorker-15] [6bc3be61-f4b3-4817-9f94-55de5a850645] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:48:00.295392096Z [2024-02-23 01:48:00,295: INFO/ForkPoolWorker-16] [e8583b78-5a62-46e7-9ef3-c6552148b151] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:48:00.299297906Z [2024-02-23 01:48:00,298: INFO/ForkPoolWorker-1] [f88d6c61-a955-4307-9d85-ba2ab5f95b1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:48:00.304095469Z [2024-02-23 01:48:00,303: INFO/ForkPoolWorker-2] [20420572-d2f6-46b6-9710-8b68d16999e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:48:00.628582837Z [2024-02-23 01:48:00,625: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:48:00.634525569Z [2024-02-23 01:48:00,631: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:48:00.652731390Z [2024-02-23 01:48:00,649: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:48:00.718780558Z [2024-02-23 01:48:00,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:48:00.790129190Z [2024-02-23 01:48:00,789: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:48:00.795687824Z [2024-02-23 01:48:00,795: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:48:00.834746539Z [2024-02-23 01:48:00,834: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:48:00.837435636Z [2024-02-23 01:48:00,837: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:48:00.837647384Z [2024-02-23 01:48:00,837: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:48:00.837799917Z [2024-02-23 01:48:00,837: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:48:00.838188430Z [2024-02-23 01:48:00,838: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:48:00.925193203Z [2024-02-23 01:48:00,924: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:48:00.946291741Z [2024-02-23 01:48:00,946: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:48:01.581535000Z [2024-02-23 01:48:01,581: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6bc3be61-f4b3-4817-9f94-55de5a850645] succeeded in 1.3011327420008456s: None 2024-02-23T01:48:01.641201997Z [2024-02-23 01:48:01,640: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20420572-d2f6-46b6-9710-8b68d16999e6] succeeded in 1.3474230769988935s: None 2024-02-23T01:48:02.002770009Z [2024-02-23 01:48:02,002: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:48:02.009138512Z [2024-02-23 01:48:02,008: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:48:02.037690608Z [2024-02-23 01:48:02,037: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:48:02.039250347Z [2024-02-23 01:48:02,039: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:48:02.039492236Z [2024-02-23 01:48:02,039: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:48:02.039784564Z [2024-02-23 01:48:02,039: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:48:02.039981149Z [2024-02-23 01:48:02,039: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:48:02.040385520Z [2024-02-23 01:48:02,040: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:48:02.040584166Z [2024-02-23 01:48:02,040: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:48:02.072045499Z [2024-02-23 01:48:02,071: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:48:02.075432088Z [2024-02-23 01:48:02,074: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:48:02.099887061Z [2024-02-23 01:48:02,099: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:48:02.101203851Z [2024-02-23 01:48:02,100: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:48:02.101263029Z [2024-02-23 01:48:02,101: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:48:02.101294805Z [2024-02-23 01:48:02,101: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:48:02.101309554Z [2024-02-23 01:48:02,101: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:48:02.101581931Z [2024-02-23 01:48:02,101: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:48:02.101749468Z [2024-02-23 01:48:02,101: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:48:02.126131740Z [2024-02-23 01:48:02,125: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:48:02.186532876Z [2024-02-23 01:48:02,186: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:48:04.289990193Z [2024-02-23 01:48:04,289: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f88d6c61-a955-4307-9d85-ba2ab5f95b1b] succeeded in 4.000073548000728s: None 2024-02-23T01:48:04.843525524Z [2024-02-23 01:48:04,843: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8583b78-5a62-46e7-9ef3-c6552148b151] succeeded in 4.558572055000695s: None 2024-02-23T01:49:01.226760537Z [2024-02-23 01:49:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d41450a-4e1f-4f05-aa77-478bacad1388] received 2024-02-23T01:49:01.232088654Z [2024-02-23 01:49:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1028443-bafb-44fd-9751-ff7a25f7e056] received 2024-02-23T01:49:01.236111892Z [2024-02-23 01:49:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff8e48c4-ec7d-4557-be6d-4d05ae719470] received 2024-02-23T01:49:01.242374211Z [2024-02-23 01:49:01,241: INFO/ForkPoolWorker-15] [9d41450a-4e1f-4f05-aa77-478bacad1388] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:49:01.257567028Z [2024-02-23 01:49:01,257: INFO/ForkPoolWorker-16] [c1028443-bafb-44fd-9751-ff7a25f7e056] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:49:01.262103717Z [2024-02-23 01:49:01,261: INFO/ForkPoolWorker-1] [ff8e48c4-ec7d-4557-be6d-4d05ae719470] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:49:01.558685876Z [2024-02-23 01:49:01,555: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:49:01.584841924Z [2024-02-23 01:49:01,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:49:01.588844953Z [2024-02-23 01:49:01,584: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:49:01.718177667Z [2024-02-23 01:49:01,717: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:49:01.722201085Z [2024-02-23 01:49:01,721: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:49:01.744963116Z [2024-02-23 01:49:01,744: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:49:01.746496433Z [2024-02-23 01:49:01,746: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:49:01.746699961Z [2024-02-23 01:49:01,746: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:49:01.746836561Z [2024-02-23 01:49:01,746: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:49:01.747207401Z [2024-02-23 01:49:01,746: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:49:01.841184587Z [2024-02-23 01:49:01,840: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:49:02.451559062Z [2024-02-23 01:49:02,451: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1028443-bafb-44fd-9751-ff7a25f7e056] succeeded in 1.2157203249989834s: None 2024-02-23T01:49:02.829284915Z [2024-02-23 01:49:02,828: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:49:02.833127622Z [2024-02-23 01:49:02,832: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:49:02.856337465Z [2024-02-23 01:49:02,855: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:49:02.860245414Z [2024-02-23 01:49:02,859: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:49:02.860408719Z [2024-02-23 01:49:02,860: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:49:02.860612099Z [2024-02-23 01:49:02,860: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:49:02.860764545Z [2024-02-23 01:49:02,860: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:49:02.861151593Z [2024-02-23 01:49:02,860: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:49:02.861323468Z [2024-02-23 01:49:02,861: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:49:02.918125580Z [2024-02-23 01:49:02,917: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:49:02.922091215Z [2024-02-23 01:49:02,921: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:49:02.942506709Z [2024-02-23 01:49:02,942: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:49:02.943963719Z [2024-02-23 01:49:02,943: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:49:02.943981494Z [2024-02-23 01:49:02,943: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:49:02.944144545Z [2024-02-23 01:49:02,943: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:49:02.944265764Z [2024-02-23 01:49:02,944: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:49:02.944503017Z [2024-02-23 01:49:02,944: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:49:02.944514840Z [2024-02-23 01:49:02,944: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:49:02.959276887Z [2024-02-23 01:49:02,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:49:03.041550212Z [2024-02-23 01:49:03,041: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:49:04.681083705Z [2024-02-23 01:49:04,680: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d41450a-4e1f-4f05-aa77-478bacad1388] succeeded in 3.4513148910009477s: None 2024-02-23T01:49:05.584265736Z [2024-02-23 01:49:05,583: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff8e48c4-ec7d-4557-be6d-4d05ae719470] succeeded in 4.344744446001641s: None 2024-02-23T01:50:00.897892729Z [2024-02-23 01:50:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ecef509-60d3-45e4-beff-8363c5ea906f] received 2024-02-23T01:50:00.903759818Z [2024-02-23 01:50:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd8bd697-d8ea-4a92-b504-a29f385eaa81] received 2024-02-23T01:50:00.910123278Z [2024-02-23 01:50:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b20c1ef5-a006-40f0-b820-56c57d9d6e4b] received 2024-02-23T01:50:00.910614452Z [2024-02-23 01:50:00,910: INFO/ForkPoolWorker-16] [bd8bd697-d8ea-4a92-b504-a29f385eaa81] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:50:00.911331086Z [2024-02-23 01:50:00,911: INFO/ForkPoolWorker-15] [7ecef509-60d3-45e4-beff-8363c5ea906f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:50:00.914915390Z [2024-02-23 01:50:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8957e9e-fda0-434e-81b5-b1f2990a3f97] received 2024-02-23T01:50:00.917140872Z [2024-02-23 01:50:00,916: INFO/ForkPoolWorker-1] [b20c1ef5-a006-40f0-b820-56c57d9d6e4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:50:00.931883824Z [2024-02-23 01:50:00,931: INFO/ForkPoolWorker-2] [f8957e9e-fda0-434e-81b5-b1f2990a3f97] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:50:00.943417874Z [2024-02-23 01:50:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff08303a-f517-48f8-9b49-ed62e8d61aaf] received 2024-02-23T01:50:00.963903939Z [2024-02-23 01:50:00,963: INFO/ForkPoolWorker-3] [ff08303a-f517-48f8-9b49-ed62e8d61aaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:50:01.227981399Z [2024-02-23 01:50:01,225: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:50:01.330260749Z [2024-02-23 01:50:01,327: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:50:01.331239609Z [2024-02-23 01:50:01,327: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:50:01.466298751Z [2024-02-23 01:50:01,466: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:01.512786336Z [2024-02-23 01:50:01,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:50:01.724402322Z [2024-02-23 01:50:01,720: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:50:01.894440086Z [2024-02-23 01:50:01,894: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:50:01.900391331Z [2024-02-23 01:50:01,899: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:01.953345493Z [2024-02-23 01:50:01,953: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:50:01.956475588Z [2024-02-23 01:50:01,956: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:50:01.956983769Z [2024-02-23 01:50:01,956: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:50:01.957184016Z [2024-02-23 01:50:01,956: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:50:01.957512135Z [2024-02-23 01:50:01,957: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:50:02.067416900Z [2024-02-23 01:50:02,067: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:02.118698107Z [2024-02-23 01:50:02,118: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd8bd697-d8ea-4a92-b504-a29f385eaa81] succeeded in 1.212639079998553s: None 2024-02-23T01:50:02.682621357Z [2024-02-23 01:50:02,682: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f8957e9e-fda0-434e-81b5-b1f2990a3f97] succeeded in 1.7623948889995518s: None 2024-02-23T01:50:02.734193093Z [2024-02-23 01:50:02,733: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:50:02.737597892Z [2024-02-23 01:50:02,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:02.767624619Z [2024-02-23 01:50:02,767: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:50:02.769866153Z [2024-02-23 01:50:02,769: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:50:02.769993240Z [2024-02-23 01:50:02,769: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:50:02.770183321Z [2024-02-23 01:50:02,769: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:50:02.770282306Z [2024-02-23 01:50:02,770: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:50:02.770626750Z [2024-02-23 01:50:02,770: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:50:02.770747430Z [2024-02-23 01:50:02,770: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:50:02.895956249Z [2024-02-23 01:50:02,895: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:02.949417708Z [2024-02-23 01:50:02,948: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:50:02.956990605Z [2024-02-23 01:50:02,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:02.984670304Z [2024-02-23 01:50:02,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:50:02.986466373Z [2024-02-23 01:50:02,986: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:50:02.986556419Z [2024-02-23 01:50:02,986: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:50:02.986708132Z [2024-02-23 01:50:02,986: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:50:02.986787483Z [2024-02-23 01:50:02,986: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:50:02.988334873Z [2024-02-23 01:50:02,988: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:50:02.988409964Z [2024-02-23 01:50:02,988: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:50:03.093044848Z [2024-02-23 01:50:03,092: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:03.380258682Z [2024-02-23 01:50:03,379: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T01:50:03.387081912Z [2024-02-23 01:50:03,386: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:03.413087294Z [2024-02-23 01:50:03,412: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T01:50:03.414566390Z [2024-02-23 01:50:03,414: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:50:03.414598410Z [2024-02-23 01:50:03,414: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:50:03.414744817Z [2024-02-23 01:50:03,414: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:50:03.414768928Z [2024-02-23 01:50:03,414: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T01:50:03.415247423Z [2024-02-23 01:50:03,415: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:50:03.415267728Z [2024-02-23 01:50:03,415: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:50:03.511627555Z [2024-02-23 01:50:03,511: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:03.722598332Z [2024-02-23 01:50:03,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ecef509-60d3-45e4-beff-8363c5ea906f] succeeded in 2.8173902819999057s: None 2024-02-23T01:50:03.800605838Z [2024-02-23 01:50:03,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7439f448-9f26-418b-868e-42805b5e0fb0] received 2024-02-23T01:50:03.818223752Z [2024-02-23 01:50:03,817: INFO/ForkPoolWorker-15] [7439f448-9f26-418b-868e-42805b5e0fb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:50:04.152856806Z [2024-02-23 01:50:04,149: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:50:04.823817012Z [2024-02-23 01:50:04,823: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b20c1ef5-a006-40f0-b820-56c57d9d6e4b] succeeded in 3.9114416760003223s: None 2024-02-23T01:50:05.129272636Z [2024-02-23 01:50:05,128: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ff08303a-f517-48f8-9b49-ed62e8d61aaf] succeeded in 4.177404451000257s: None 2024-02-23T01:50:05.313197620Z [2024-02-23 01:50:05,312: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:50:05.316353418Z [2024-02-23 01:50:05,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:05.351297287Z [2024-02-23 01:50:05,351: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:50:05.352499650Z [2024-02-23 01:50:05,352: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:50:05.352553484Z [2024-02-23 01:50:05,352: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:50:05.352658840Z [2024-02-23 01:50:05,352: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:50:05.352724703Z [2024-02-23 01:50:05,352: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:50:05.352983281Z [2024-02-23 01:50:05,352: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:50:05.353029057Z [2024-02-23 01:50:05,352: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:50:05.444581562Z [2024-02-23 01:50:05,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:06.106569869Z [2024-02-23 01:50:06,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7439f448-9f26-418b-868e-42805b5e0fb0] succeeded in 2.3017226239990123s: None 2024-02-23T01:50:06.243699227Z [2024-02-23 01:50:06,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7973a31-98cd-4ef7-a317-196b61d71e6c] received 2024-02-23T01:50:06.250887411Z [2024-02-23 01:50:06,250: INFO/ForkPoolWorker-15] [f7973a31-98cd-4ef7-a317-196b61d71e6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:50:06.517730714Z [2024-02-23 01:50:06,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:50:07.591956616Z [2024-02-23 01:50:07,591: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:50:07.595481072Z [2024-02-23 01:50:07,594: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:07.612586071Z [2024-02-23 01:50:07,612: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:50:07.614496405Z [2024-02-23 01:50:07,614: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:50:07.614592037Z [2024-02-23 01:50:07,614: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:50:07.614914557Z [2024-02-23 01:50:07,614: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:50:07.615140893Z [2024-02-23 01:50:07,614: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:50:07.615753501Z [2024-02-23 01:50:07,615: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:50:07.615854675Z [2024-02-23 01:50:07,615: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:50:07.715152896Z [2024-02-23 01:50:07,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:08.303186355Z [2024-02-23 01:50:08,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7973a31-98cd-4ef7-a317-196b61d71e6c] succeeded in 2.0571086749987444s: None 2024-02-23T01:50:08.359926435Z [2024-02-23 01:50:08,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f920479-4eb3-450c-98b2-8301adc15e92] received 2024-02-23T01:50:08.371167877Z [2024-02-23 01:50:08,370: INFO/ForkPoolWorker-15] [3f920479-4eb3-450c-98b2-8301adc15e92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:50:08.672265407Z [2024-02-23 01:50:08,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:50:09.817126341Z [2024-02-23 01:50:09,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:50:09.820297582Z [2024-02-23 01:50:09,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:50:09.835425482Z [2024-02-23 01:50:09,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:50:09.836384946Z [2024-02-23 01:50:09,836: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:50:09.836400864Z [2024-02-23 01:50:09,836: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:50:09.836524100Z [2024-02-23 01:50:09,836: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:50:09.836574849Z [2024-02-23 01:50:09,836: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:50:09.836801503Z [2024-02-23 01:50:09,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:50:09.836877729Z [2024-02-23 01:50:09,836: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:50:09.968082481Z [2024-02-23 01:50:09,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:50:10.648293552Z [2024-02-23 01:50:10,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f920479-4eb3-450c-98b2-8301adc15e92] succeeded in 2.2843865640006698s: None 2024-02-23T01:51:00.966259341Z [2024-02-23 01:51:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50b2a00b-13fa-4747-87e6-d4e755e3a223] received 2024-02-23T01:51:00.972739779Z [2024-02-23 01:51:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fe3ffd1-0a22-4e70-b1ba-c58c4fd5d5e7] received 2024-02-23T01:51:00.975119692Z [2024-02-23 01:51:00,974: INFO/ForkPoolWorker-15] [50b2a00b-13fa-4747-87e6-d4e755e3a223] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:51:00.977361521Z [2024-02-23 01:51:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbc69e74-53c3-4dd1-a6b7-b5e972f5fff3] received 2024-02-23T01:51:00.981750144Z [2024-02-23 01:51:00,981: INFO/ForkPoolWorker-16] [6fe3ffd1-0a22-4e70-b1ba-c58c4fd5d5e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:51:00.984700151Z [2024-02-23 01:51:00,984: INFO/ForkPoolWorker-1] [dbc69e74-53c3-4dd1-a6b7-b5e972f5fff3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:51:01.272057397Z [2024-02-23 01:51:01,269: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:51:01.322909706Z [2024-02-23 01:51:01,319: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:51:01.326910865Z [2024-02-23 01:51:01,323: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:51:01.494099122Z [2024-02-23 01:51:01,493: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T01:51:01.498014370Z [2024-02-23 01:51:01,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:51:01.516787383Z [2024-02-23 01:51:01,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:51:01.517740610Z [2024-02-23 01:51:01,517: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:51:01.517834111Z [2024-02-23 01:51:01,517: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:51:01.517925958Z [2024-02-23 01:51:01,517: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T01:51:01.518185582Z [2024-02-23 01:51:01,518: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:51:01.601307543Z [2024-02-23 01:51:01,601: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:51:02.234306263Z [2024-02-23 01:51:02,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50b2a00b-13fa-4747-87e6-d4e755e3a223] succeeded in 1.2658641050002188s: None 2024-02-23T01:51:02.471461428Z [2024-02-23 01:51:02,471: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:51:02.474873290Z [2024-02-23 01:51:02,474: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:51:02.498733231Z [2024-02-23 01:51:02,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:51:02.500525593Z [2024-02-23 01:51:02,500: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:51:02.500677950Z [2024-02-23 01:51:02,500: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:51:02.500728643Z [2024-02-23 01:51:02,500: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:51:02.500740412Z [2024-02-23 01:51:02,500: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:51:02.500910341Z [2024-02-23 01:51:02,500: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:51:02.500958409Z [2024-02-23 01:51:02,500: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:51:02.557305224Z [2024-02-23 01:51:02,556: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:51:02.560912965Z [2024-02-23 01:51:02,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:51:02.581806712Z [2024-02-23 01:51:02,581: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:51:02.583517420Z [2024-02-23 01:51:02,583: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:51:02.583632018Z [2024-02-23 01:51:02,583: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:51:02.583719698Z [2024-02-23 01:51:02,583: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:51:02.583841685Z [2024-02-23 01:51:02,583: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:51:02.584188923Z [2024-02-23 01:51:02,583: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:51:02.584303796Z [2024-02-23 01:51:02,584: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:51:02.609665152Z [2024-02-23 01:51:02,609: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:51:02.681347408Z [2024-02-23 01:51:02,681: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:51:04.395815279Z [2024-02-23 01:51:04,395: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fe3ffd1-0a22-4e70-b1ba-c58c4fd5d5e7] succeeded in 3.420122707999326s: None 2024-02-23T01:51:04.894939635Z [2024-02-23 01:51:04,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbc69e74-53c3-4dd1-a6b7-b5e972f5fff3] succeeded in 3.916169701000399s: None 2024-02-23T01:52:00.941332235Z [2024-02-23 01:52:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f443b85d-46d8-46e7-a9c9-3a80293c3f5d] received 2024-02-23T01:52:00.947349950Z [2024-02-23 01:52:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5509cd6c-6d4f-4bf8-bddf-dd8842b64c6b] received 2024-02-23T01:52:00.954539425Z [2024-02-23 01:52:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fdb45dc-b871-46a3-b2a9-f7bc2aece810] received 2024-02-23T01:52:00.956082230Z [2024-02-23 01:52:00,955: INFO/ForkPoolWorker-16] [5509cd6c-6d4f-4bf8-bddf-dd8842b64c6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:52:00.956687848Z [2024-02-23 01:52:00,956: INFO/ForkPoolWorker-15] [f443b85d-46d8-46e7-a9c9-3a80293c3f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:52:00.961040597Z [2024-02-23 01:52:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13dc105b-4eff-43a1-81e8-964b7483818b] received 2024-02-23T01:52:00.966721980Z [2024-02-23 01:52:00,966: INFO/ForkPoolWorker-2] [13dc105b-4eff-43a1-81e8-964b7483818b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:52:00.969386519Z [2024-02-23 01:52:00,969: INFO/ForkPoolWorker-1] [2fdb45dc-b871-46a3-b2a9-f7bc2aece810] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:52:01.320245895Z [2024-02-23 01:52:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:52:01.374187485Z [2024-02-23 01:52:01,371: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:52:01.440381516Z [2024-02-23 01:52:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:52:01.454290563Z [2024-02-23 01:52:01,451: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:52:01.640144960Z [2024-02-23 01:52:01,639: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:52:01.654392683Z [2024-02-23 01:52:01,653: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:52:01.694421959Z [2024-02-23 01:52:01,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:52:01.701726061Z [2024-02-23 01:52:01,701: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:52:01.703148167Z [2024-02-23 01:52:01,702: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:52:01.703263959Z [2024-02-23 01:52:01,703: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:52:01.703336850Z [2024-02-23 01:52:01,703: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:52:01.703560388Z [2024-02-23 01:52:01,703: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:52:01.824892469Z [2024-02-23 01:52:01,824: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:52:02.346726737Z [2024-02-23 01:52:02,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f443b85d-46d8-46e7-a9c9-3a80293c3f5d] succeeded in 1.3997175399999833s: None 2024-02-23T01:52:02.402255606Z [2024-02-23 01:52:02,401: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5509cd6c-6d4f-4bf8-bddf-dd8842b64c6b] succeeded in 1.4530984650009486s: None 2024-02-23T01:52:02.763689798Z [2024-02-23 01:52:02,763: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:52:02.767165544Z [2024-02-23 01:52:02,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:52:02.802142032Z [2024-02-23 01:52:02,801: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:52:02.803468940Z [2024-02-23 01:52:02,803: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:52:02.803484268Z [2024-02-23 01:52:02,803: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:52:02.803556790Z [2024-02-23 01:52:02,803: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:52:02.803582709Z [2024-02-23 01:52:02,803: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:52:02.803852165Z [2024-02-23 01:52:02,803: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:52:02.803863240Z [2024-02-23 01:52:02,803: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:52:02.851041825Z [2024-02-23 01:52:02,850: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T01:52:02.854783731Z [2024-02-23 01:52:02,854: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:52:02.883888184Z [2024-02-23 01:52:02,883: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:52:02.885765270Z [2024-02-23 01:52:02,885: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:52:02.885975656Z [2024-02-23 01:52:02,885: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:52:02.886202663Z [2024-02-23 01:52:02,886: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:52:02.886350790Z [2024-02-23 01:52:02,886: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T01:52:02.886731513Z [2024-02-23 01:52:02,886: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:52:02.886961063Z [2024-02-23 01:52:02,886: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:52:02.906768633Z [2024-02-23 01:52:02,906: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:52:02.984901117Z [2024-02-23 01:52:02,984: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:52:04.532269687Z [2024-02-23 01:52:04,531: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fdb45dc-b871-46a3-b2a9-f7bc2aece810] succeeded in 3.571300390000033s: None 2024-02-23T01:52:05.220749101Z [2024-02-23 01:52:05,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[13dc105b-4eff-43a1-81e8-964b7483818b] succeeded in 4.258322347999638s: None 2024-02-23T01:53:00.800838890Z [2024-02-23 01:53:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[142193c5-a001-41f4-8c85-35f399241cb3] received 2024-02-23T01:53:00.803397978Z [2024-02-23 01:53:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2fb37bc-fce1-4ecb-83ae-9b6bbe1f6a78] received 2024-02-23T01:53:00.805122080Z [2024-02-23 01:53:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77a1e572-a9dc-4517-aeb1-da3e87f40c00] received 2024-02-23T01:53:00.816342646Z [2024-02-23 01:53:00,816: INFO/ForkPoolWorker-16] [f2fb37bc-fce1-4ecb-83ae-9b6bbe1f6a78] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:53:00.816500989Z [2024-02-23 01:53:00,816: INFO/ForkPoolWorker-1] [77a1e572-a9dc-4517-aeb1-da3e87f40c00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:53:00.817267557Z [2024-02-23 01:53:00,817: INFO/ForkPoolWorker-15] [142193c5-a001-41f4-8c85-35f399241cb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:53:01.149471277Z [2024-02-23 01:53:01,146: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:53:01.155010105Z [2024-02-23 01:53:01,149: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:53:01.161795453Z [2024-02-23 01:53:01,159: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:53:01.359099485Z [2024-02-23 01:53:01,358: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:53:01.363046152Z [2024-02-23 01:53:01,362: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:53:01.389551008Z [2024-02-23 01:53:01,389: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:53:01.391674271Z [2024-02-23 01:53:01,391: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:53:01.391979535Z [2024-02-23 01:53:01,391: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:53:01.392169051Z [2024-02-23 01:53:01,391: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:53:01.392615754Z [2024-02-23 01:53:01,392: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:53:01.491293836Z [2024-02-23 01:53:01,490: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:53:02.091777106Z [2024-02-23 01:53:02,091: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2fb37bc-fce1-4ecb-83ae-9b6bbe1f6a78] succeeded in 1.2869258869995974s: None 2024-02-23T01:53:02.483138542Z [2024-02-23 01:53:02,482: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:53:02.486224854Z [2024-02-23 01:53:02,485: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:53:02.511684887Z [2024-02-23 01:53:02,511: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:53:02.513350949Z [2024-02-23 01:53:02,513: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:53:02.513472071Z [2024-02-23 01:53:02,513: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:53:02.513548138Z [2024-02-23 01:53:02,513: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:53:02.513585099Z [2024-02-23 01:53:02,513: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:53:02.513851228Z [2024-02-23 01:53:02,513: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:53:02.513899392Z [2024-02-23 01:53:02,513: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:53:02.619663417Z [2024-02-23 01:53:02,619: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:53:02.673359551Z [2024-02-23 01:53:02,673: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:53:02.676915338Z [2024-02-23 01:53:02,676: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:53:02.696844401Z [2024-02-23 01:53:02,696: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:53:02.698593878Z [2024-02-23 01:53:02,698: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:53:02.698793704Z [2024-02-23 01:53:02,698: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:53:02.699161750Z [2024-02-23 01:53:02,698: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:53:02.699304666Z [2024-02-23 01:53:02,699: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:53:02.699936479Z [2024-02-23 01:53:02,699: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:53:02.700203374Z [2024-02-23 01:53:02,700: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:53:02.788708216Z [2024-02-23 01:53:02,788: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:53:04.143262287Z [2024-02-23 01:53:04,142: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77a1e572-a9dc-4517-aeb1-da3e87f40c00] succeeded in 3.3338657460008108s: None 2024-02-23T01:53:04.759263722Z [2024-02-23 01:53:04,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[142193c5-a001-41f4-8c85-35f399241cb3] succeeded in 3.9531601350008714s: None 2024-02-23T01:54:01.287725642Z [2024-02-23 01:54:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a906751-fc89-49e2-9c7f-aeb735b032f6] received 2024-02-23T01:54:01.291201008Z [2024-02-23 01:54:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66dd5f9d-e8f9-4c6b-99e0-1b50f449ebfa] received 2024-02-23T01:54:01.298384018Z [2024-02-23 01:54:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4810c86d-efaa-4126-a910-f63a88fa6063] received 2024-02-23T01:54:01.299800271Z [2024-02-23 01:54:01,299: INFO/ForkPoolWorker-15] [1a906751-fc89-49e2-9c7f-aeb735b032f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:54:01.300873391Z [2024-02-23 01:54:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2022b8f7-9805-4dc6-ac8b-68476badd1d6] received 2024-02-23T01:54:01.308599952Z [2024-02-23 01:54:01,308: INFO/ForkPoolWorker-2] [2022b8f7-9805-4dc6-ac8b-68476badd1d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:54:01.308701133Z [2024-02-23 01:54:01,308: INFO/ForkPoolWorker-1] [4810c86d-efaa-4126-a910-f63a88fa6063] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:54:01.309111868Z [2024-02-23 01:54:01,308: INFO/ForkPoolWorker-16] [66dd5f9d-e8f9-4c6b-99e0-1b50f449ebfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:54:01.604493543Z [2024-02-23 01:54:01,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:54:01.625337788Z [2024-02-23 01:54:01,622: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:54:01.675210338Z [2024-02-23 01:54:01,671: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:54:01.722706038Z [2024-02-23 01:54:01,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:54:01.837750904Z [2024-02-23 01:54:01,837: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:54:01.843062451Z [2024-02-23 01:54:01,842: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:54:01.878746948Z [2024-02-23 01:54:01,878: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:54:01.880841594Z [2024-02-23 01:54:01,880: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:54:01.881159903Z [2024-02-23 01:54:01,880: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:54:01.881440456Z [2024-02-23 01:54:01,881: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:54:01.881814860Z [2024-02-23 01:54:01,881: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:54:02.018963645Z [2024-02-23 01:54:02,018: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:54:02.027272054Z [2024-02-23 01:54:02,026: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:54:02.651227785Z [2024-02-23 01:54:02,650: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2022b8f7-9805-4dc6-ac8b-68476badd1d6] succeeded in 1.3488591660006932s: None 2024-02-23T01:54:02.734438734Z [2024-02-23 01:54:02,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a906751-fc89-49e2-9c7f-aeb735b032f6] succeeded in 1.442014623000432s: None 2024-02-23T01:54:03.156632953Z [2024-02-23 01:54:03,156: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:54:03.171054818Z [2024-02-23 01:54:03,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:54:03.209223892Z [2024-02-23 01:54:03,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:54:03.210653835Z [2024-02-23 01:54:03,209: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:54:03.210682138Z [2024-02-23 01:54:03,210: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:54:03.210690180Z [2024-02-23 01:54:03,210: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:54:03.210693933Z [2024-02-23 01:54:03,210: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:54:03.210697157Z [2024-02-23 01:54:03,210: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:54:03.210766016Z [2024-02-23 01:54:03,210: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:54:03.318808073Z [2024-02-23 01:54:03,318: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:54:03.335192587Z [2024-02-23 01:54:03,334: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:54:03.338790449Z [2024-02-23 01:54:03,338: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:54:03.360334405Z [2024-02-23 01:54:03,360: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:54:03.361926290Z [2024-02-23 01:54:03,361: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:54:03.362149041Z [2024-02-23 01:54:03,362: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:54:03.362403633Z [2024-02-23 01:54:03,362: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:54:03.362542458Z [2024-02-23 01:54:03,362: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:54:03.362911881Z [2024-02-23 01:54:03,362: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:54:03.363073534Z [2024-02-23 01:54:03,362: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:54:03.470399590Z [2024-02-23 01:54:03,470: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:54:05.514170888Z [2024-02-23 01:54:05,513: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66dd5f9d-e8f9-4c6b-99e0-1b50f449ebfa] succeeded in 4.221252088000256s: None 2024-02-23T01:54:05.776942152Z [2024-02-23 01:54:05,776: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4810c86d-efaa-4126-a910-f63a88fa6063] succeeded in 4.476180343999658s: None 2024-02-23T01:55:00.662757157Z [2024-02-23 01:55:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f28cad5-6a9d-437c-b6cf-b73c25188f05] received 2024-02-23T01:55:00.669519905Z [2024-02-23 01:55:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1819f1b-02eb-4f80-ab02-2415476fbfff] received 2024-02-23T01:55:00.674171006Z [2024-02-23 01:55:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e7a0b1c-c8cd-40dd-9c67-9a64a2a6d7d1] received 2024-02-23T01:55:00.677717125Z [2024-02-23 01:55:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afd8d53e-d369-4269-9c54-66d4f77a5d63] received 2024-02-23T01:55:00.678508234Z [2024-02-23 01:55:00,678: INFO/ForkPoolWorker-16] [e1819f1b-02eb-4f80-ab02-2415476fbfff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:55:00.687925114Z [2024-02-23 01:55:00,687: INFO/ForkPoolWorker-1] [4e7a0b1c-c8cd-40dd-9c67-9a64a2a6d7d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:55:00.688433603Z [2024-02-23 01:55:00,688: INFO/ForkPoolWorker-15] [5f28cad5-6a9d-437c-b6cf-b73c25188f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:55:00.688697276Z [2024-02-23 01:55:00,688: INFO/ForkPoolWorker-2] [afd8d53e-d369-4269-9c54-66d4f77a5d63] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:55:01.018949857Z [2024-02-23 01:55:01,015: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:55:01.041660816Z [2024-02-23 01:55:01,034: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:55:01.056220364Z [2024-02-23 01:55:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:55:01.062343271Z [2024-02-23 01:55:01,057: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:55:01.327958357Z [2024-02-23 01:55:01,327: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:55:01.338142329Z [2024-02-23 01:55:01,337: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:01.384098110Z [2024-02-23 01:55:01,383: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:55:01.388949250Z [2024-02-23 01:55:01,388: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:55:01.389336650Z [2024-02-23 01:55:01,389: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:55:01.389662822Z [2024-02-23 01:55:01,389: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:55:01.390207810Z [2024-02-23 01:55:01,389: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:55:01.496603766Z [2024-02-23 01:55:01,496: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:02.130198375Z [2024-02-23 01:55:02,129: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[afd8d53e-d369-4269-9c54-66d4f77a5d63] succeeded in 1.450780560999192s: None 2024-02-23T01:55:02.327990558Z [2024-02-23 01:55:02,327: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:55:02.331744591Z [2024-02-23 01:55:02,331: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:02.371051649Z [2024-02-23 01:55:02,370: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:55:02.374678389Z [2024-02-23 01:55:02,374: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:02.384270020Z [2024-02-23 01:55:02,383: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:55:02.389443993Z [2024-02-23 01:55:02,389: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:55:02.389802222Z [2024-02-23 01:55:02,389: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:55:02.390154991Z [2024-02-23 01:55:02,389: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:55:02.390455666Z [2024-02-23 01:55:02,390: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:55:02.391519460Z [2024-02-23 01:55:02,391: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:55:02.391829679Z [2024-02-23 01:55:02,391: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:55:02.402636143Z [2024-02-23 01:55:02,402: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:55:02.407569580Z [2024-02-23 01:55:02,407: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:55:02.407633737Z [2024-02-23 01:55:02,407: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:55:02.407808826Z [2024-02-23 01:55:02,407: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:55:02.407919807Z [2024-02-23 01:55:02,407: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:55:02.408269964Z [2024-02-23 01:55:02,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:55:02.408526092Z [2024-02-23 01:55:02,408: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:55:02.511525974Z [2024-02-23 01:55:02,511: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:02.511986815Z [2024-02-23 01:55:02,511: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:02.514215540Z [2024-02-23 01:55:02,513: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:55:02.517781924Z [2024-02-23 01:55:02,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:02.545822696Z [2024-02-23 01:55:02,545: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:55:02.548503371Z [2024-02-23 01:55:02,547: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:55:02.549286629Z [2024-02-23 01:55:02,549: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:55:02.549422922Z [2024-02-23 01:55:02,549: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:55:02.549483007Z [2024-02-23 01:55:02,549: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:55:02.549754068Z [2024-02-23 01:55:02,549: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:55:02.550128407Z [2024-02-23 01:55:02,549: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:55:02.649068712Z [2024-02-23 01:55:02,648: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:03.300915707Z [2024-02-23 01:55:03,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f28cad5-6a9d-437c-b6cf-b73c25188f05] succeeded in 2.6292452340003365s: None 2024-02-23T01:55:03.309754328Z [2024-02-23 01:55:03,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0aa2b41-3713-4011-b477-6223b544f693] received 2024-02-23T01:55:03.324863416Z [2024-02-23 01:55:03,324: INFO/ForkPoolWorker-15] [b0aa2b41-3713-4011-b477-6223b544f693] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:55:03.684798933Z [2024-02-23 01:55:03,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:55:04.443309498Z [2024-02-23 01:55:04,442: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e7a0b1c-c8cd-40dd-9c67-9a64a2a6d7d1] succeeded in 3.7657589460013696s: None 2024-02-23T01:55:04.906759884Z [2024-02-23 01:55:04,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:55:04.910296973Z [2024-02-23 01:55:04,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:04.935494362Z [2024-02-23 01:55:04,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:55:04.937521632Z [2024-02-23 01:55:04,937: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:55:04.937567639Z [2024-02-23 01:55:04,937: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:55:04.937795418Z [2024-02-23 01:55:04,937: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:55:04.937877470Z [2024-02-23 01:55:04,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:55:04.938221134Z [2024-02-23 01:55:04,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:55:04.938256413Z [2024-02-23 01:55:04,938: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:55:05.042255619Z [2024-02-23 01:55:05,041: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:05.216063387Z [2024-02-23 01:55:05,215: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e1819f1b-02eb-4f80-ab02-2415476fbfff] succeeded in 4.54512570100087s: None 2024-02-23T01:55:05.749796163Z [2024-02-23 01:55:05,749: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0aa2b41-3713-4011-b477-6223b544f693] succeeded in 2.4338538920001156s: None 2024-02-23T01:55:05.798201464Z [2024-02-23 01:55:05,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a6b7cbe-5837-4345-882a-ab80e53c3e11] received 2024-02-23T01:55:05.810746116Z [2024-02-23 01:55:05,810: INFO/ForkPoolWorker-15] [5a6b7cbe-5837-4345-882a-ab80e53c3e11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T01:55:06.093353974Z [2024-02-23 01:55:06,090: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:55:07.264427611Z [2024-02-23 01:55:07,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:55:07.267854776Z [2024-02-23 01:55:07,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:07.289891060Z [2024-02-23 01:55:07,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:55:07.291825048Z [2024-02-23 01:55:07,291: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:55:07.291924649Z [2024-02-23 01:55:07,291: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:55:07.292326426Z [2024-02-23 01:55:07,291: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:55:07.292435942Z [2024-02-23 01:55:07,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:55:07.293074145Z [2024-02-23 01:55:07,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:55:07.293233334Z [2024-02-23 01:55:07,293: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:55:07.402801126Z [2024-02-23 01:55:07,402: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:08.164122745Z [2024-02-23 01:55:08,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a6b7cbe-5837-4345-882a-ab80e53c3e11] succeeded in 2.360138347999964s: None 2024-02-23T01:55:08.191476718Z [2024-02-23 01:55:08,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2341db0-bdfe-4ae2-baa8-514e45cadce2] received 2024-02-23T01:55:08.202628022Z [2024-02-23 01:55:08,202: INFO/ForkPoolWorker-15] [d2341db0-bdfe-4ae2-baa8-514e45cadce2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T01:55:08.478277064Z [2024-02-23 01:55:08,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T01:55:09.548605080Z [2024-02-23 01:55:09,548: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:55:09.551851886Z [2024-02-23 01:55:09,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:55:09.571782422Z [2024-02-23 01:55:09,571: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:55:09.573548204Z [2024-02-23 01:55:09,573: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:55:09.573654822Z [2024-02-23 01:55:09,573: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:55:09.573903468Z [2024-02-23 01:55:09,573: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:55:09.574002479Z [2024-02-23 01:55:09,573: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:55:09.574326888Z [2024-02-23 01:55:09,574: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T01:55:09.574436137Z [2024-02-23 01:55:09,574: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:55:09.680328757Z [2024-02-23 01:55:09,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:55:10.322106194Z [2024-02-23 01:55:10,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2341db0-bdfe-4ae2-baa8-514e45cadce2] succeeded in 2.1277973229989584s: None 2024-02-23T01:56:01.168667182Z [2024-02-23 01:56:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c151085-d5ff-4ef0-ab9e-e646600b214c] received 2024-02-23T01:56:01.170534937Z [2024-02-23 01:56:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03eb43d6-cdc7-4639-bbc6-666cb9b20c1b] received 2024-02-23T01:56:01.174311203Z [2024-02-23 01:56:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d5bb302-c021-4bee-a67a-08bf68bb9ca0] received 2024-02-23T01:56:01.183187372Z [2024-02-23 01:56:01,182: INFO/ForkPoolWorker-16] [03eb43d6-cdc7-4639-bbc6-666cb9b20c1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:56:01.183968868Z [2024-02-23 01:56:01,183: INFO/ForkPoolWorker-15] [5c151085-d5ff-4ef0-ab9e-e646600b214c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:56:01.185193197Z [2024-02-23 01:56:01,184: INFO/ForkPoolWorker-1] [4d5bb302-c021-4bee-a67a-08bf68bb9ca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:56:01.188524848Z [2024-02-23 01:56:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aefb72d9-8516-48a7-8f34-1fab6204a0f6] received 2024-02-23T01:56:01.211615271Z [2024-02-23 01:56:01,211: INFO/ForkPoolWorker-2] [aefb72d9-8516-48a7-8f34-1fab6204a0f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:56:01.562358366Z [2024-02-23 01:56:01,559: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:56:01.577157914Z [2024-02-23 01:56:01,574: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:56:01.703976773Z [2024-02-23 01:56:01,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:56:01.833354607Z [2024-02-23 01:56:01,833: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:56:01.833560681Z [2024-02-23 01:56:01,830: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:56:02.068851683Z [2024-02-23 01:56:02,068: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:56:02.075257875Z [2024-02-23 01:56:02,074: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:56:02.126194997Z [2024-02-23 01:56:02,125: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:56:02.128358502Z [2024-02-23 01:56:02,128: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:56:02.128484598Z [2024-02-23 01:56:02,128: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:56:02.128612906Z [2024-02-23 01:56:02,128: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:56:02.128924759Z [2024-02-23 01:56:02,128: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:56:02.286192214Z [2024-02-23 01:56:02,285: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:56:02.479607471Z [2024-02-23 01:56:02,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c151085-d5ff-4ef0-ab9e-e646600b214c] succeeded in 1.3088745650002238s: None 2024-02-23T01:56:02.960684534Z [2024-02-23 01:56:02,960: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aefb72d9-8516-48a7-8f34-1fab6204a0f6] succeeded in 1.769568749001337s: None 2024-02-23T01:56:03.029931326Z [2024-02-23 01:56:03,029: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:56:03.033829880Z [2024-02-23 01:56:03,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:56:03.055694032Z [2024-02-23 01:56:03,055: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:56:03.057260379Z [2024-02-23 01:56:03,057: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:56:03.057953049Z [2024-02-23 01:56:03,057: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:56:03.058240628Z [2024-02-23 01:56:03,058: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:56:03.058443752Z [2024-02-23 01:56:03,058: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:56:03.058857498Z [2024-02-23 01:56:03,058: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:56:03.059068601Z [2024-02-23 01:56:03,058: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:56:03.113496816Z [2024-02-23 01:56:03,113: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:56:03.117112068Z [2024-02-23 01:56:03,116: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:56:03.141811837Z [2024-02-23 01:56:03,141: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:56:03.143857255Z [2024-02-23 01:56:03,143: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:56:03.143874029Z [2024-02-23 01:56:03,143: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:56:03.144079002Z [2024-02-23 01:56:03,143: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:56:03.144199014Z [2024-02-23 01:56:03,144: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:56:03.144559308Z [2024-02-23 01:56:03,144: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:56:03.144596990Z [2024-02-23 01:56:03,144: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:56:03.161756702Z [2024-02-23 01:56:03,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:56:03.248756753Z [2024-02-23 01:56:03,248: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:56:05.871208501Z [2024-02-23 01:56:05,870: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d5bb302-c021-4bee-a67a-08bf68bb9ca0] succeeded in 4.694735529999889s: None 2024-02-23T01:56:06.243911303Z [2024-02-23 01:56:06,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03eb43d6-cdc7-4639-bbc6-666cb9b20c1b] succeeded in 5.068537252000169s: None 2024-02-23T01:57:00.447407960Z [2024-02-23 01:57:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1224ec85-d741-475a-93a5-e529b2e89b76] received 2024-02-23T01:57:00.455564485Z [2024-02-23 01:57:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0902c831-513f-4c7e-a710-b621f45eae93] received 2024-02-23T01:57:00.455863465Z [2024-02-23 01:57:00,455: INFO/ForkPoolWorker-15] [1224ec85-d741-475a-93a5-e529b2e89b76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:57:00.457343018Z [2024-02-23 01:57:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e080ea41-70c4-4d69-a66e-a0d9779ef908] received 2024-02-23T01:57:00.463159601Z [2024-02-23 01:57:00,462: INFO/ForkPoolWorker-16] [0902c831-513f-4c7e-a710-b621f45eae93] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:57:00.476809665Z [2024-02-23 01:57:00,476: INFO/ForkPoolWorker-1] [e080ea41-70c4-4d69-a66e-a0d9779ef908] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:57:00.751588815Z [2024-02-23 01:57:00,745: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:57:00.779003913Z [2024-02-23 01:57:00,776: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:57:00.805984056Z [2024-02-23 01:57:00,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:57:00.924981903Z [2024-02-23 01:57:00,924: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T01:57:00.928702123Z [2024-02-23 01:57:00,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:57:00.968538653Z [2024-02-23 01:57:00,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:57:00.970159881Z [2024-02-23 01:57:00,969: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:57:00.970173877Z [2024-02-23 01:57:00,969: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:57:00.970179047Z [2024-02-23 01:57:00,970: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T01:57:00.970368180Z [2024-02-23 01:57:00,970: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:57:01.107886330Z [2024-02-23 01:57:01,107: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:57:01.762024738Z [2024-02-23 01:57:01,761: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0902c831-513f-4c7e-a710-b621f45eae93] succeeded in 1.3047189859989885s: None 2024-02-23T01:57:01.922925920Z [2024-02-23 01:57:01,922: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:57:01.926970937Z [2024-02-23 01:57:01,926: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:57:01.964489716Z [2024-02-23 01:57:01,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:57:01.967230678Z [2024-02-23 01:57:01,966: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:57:01.967440295Z [2024-02-23 01:57:01,967: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:57:01.967773456Z [2024-02-23 01:57:01,967: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:57:01.967918925Z [2024-02-23 01:57:01,967: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:57:01.968374830Z [2024-02-23 01:57:01,968: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:57:01.968557212Z [2024-02-23 01:57:01,968: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:57:02.077511332Z [2024-02-23 01:57:02,077: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:57:02.095615907Z [2024-02-23 01:57:02,095: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:57:02.099093305Z [2024-02-23 01:57:02,098: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:57:02.122045887Z [2024-02-23 01:57:02,121: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:57:02.124016393Z [2024-02-23 01:57:02,123: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:57:02.124184654Z [2024-02-23 01:57:02,124: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:57:02.124379945Z [2024-02-23 01:57:02,124: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:57:02.124529838Z [2024-02-23 01:57:02,124: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:57:02.124836979Z [2024-02-23 01:57:02,124: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:57:02.124950786Z [2024-02-23 01:57:02,124: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:57:02.226606312Z [2024-02-23 01:57:02,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:57:04.173221967Z [2024-02-23 01:57:04,172: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e080ea41-70c4-4d69-a66e-a0d9779ef908] succeeded in 3.713428754999768s: None 2024-02-23T01:57:04.582197345Z [2024-02-23 01:57:04,581: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1224ec85-d741-475a-93a5-e529b2e89b76] succeeded in 4.133283338000183s: None 2024-02-23T01:58:00.905089824Z [2024-02-23 01:58:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8aa372d5-b5c2-479b-b3dd-3fc5bf9419e0] received 2024-02-23T01:58:00.908510998Z [2024-02-23 01:58:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2497fa5-b9b9-4000-be7a-255b96cbfb0e] received 2024-02-23T01:58:00.912242912Z [2024-02-23 01:58:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39c65856-2257-4371-bae3-b164e6fbc088] received 2024-02-23T01:58:00.914561850Z [2024-02-23 01:58:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d541758-315b-4a51-8cbb-f42b5f0e3592] received 2024-02-23T01:58:00.916245705Z [2024-02-23 01:58:00,915: INFO/ForkPoolWorker-16] [f2497fa5-b9b9-4000-be7a-255b96cbfb0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:58:00.917571218Z [2024-02-23 01:58:00,917: INFO/ForkPoolWorker-15] [8aa372d5-b5c2-479b-b3dd-3fc5bf9419e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T01:58:00.927123656Z [2024-02-23 01:58:00,926: INFO/ForkPoolWorker-1] [39c65856-2257-4371-bae3-b164e6fbc088] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:58:00.929396041Z [2024-02-23 01:58:00,929: INFO/ForkPoolWorker-2] [7d541758-315b-4a51-8cbb-f42b5f0e3592] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:58:01.266548099Z [2024-02-23 01:58:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:58:01.277446467Z [2024-02-23 01:58:01,274: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:58:01.298810881Z [2024-02-23 01:58:01,295: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:58:01.343367769Z [2024-02-23 01:58:01,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T01:58:01.444353143Z [2024-02-23 01:58:01,443: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T01:58:01.449455385Z [2024-02-23 01:58:01,448: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:58:01.501674146Z [2024-02-23 01:58:01,501: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T01:58:01.507794831Z [2024-02-23 01:58:01,507: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:58:01.507818117Z [2024-02-23 01:58:01,507: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:58:01.507828969Z [2024-02-23 01:58:01,507: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T01:58:01.508024890Z [2024-02-23 01:58:01,507: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:58:01.632037875Z [2024-02-23 01:58:01,631: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:58:01.672866301Z [2024-02-23 01:58:01,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:58:02.214148176Z [2024-02-23 01:58:02,213: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7d541758-315b-4a51-8cbb-f42b5f0e3592] succeeded in 1.2935455209990323s: None 2024-02-23T01:58:02.455392919Z [2024-02-23 01:58:02,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8aa372d5-b5c2-479b-b3dd-3fc5bf9419e0] succeeded in 1.5482555180005875s: None 2024-02-23T01:58:02.598691735Z [2024-02-23 01:58:02,598: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T01:58:02.602160153Z [2024-02-23 01:58:02,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:58:02.637610526Z [2024-02-23 01:58:02,637: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:58:02.639498214Z [2024-02-23 01:58:02,639: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:58:02.639588651Z [2024-02-23 01:58:02,639: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:58:02.639832798Z [2024-02-23 01:58:02,639: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:58:02.640030749Z [2024-02-23 01:58:02,639: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T01:58:02.640821239Z [2024-02-23 01:58:02,640: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:58:02.640926910Z [2024-02-23 01:58:02,640: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:58:02.691867805Z [2024-02-23 01:58:02,691: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:58:02.698294681Z [2024-02-23 01:58:02,697: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:58:02.723709642Z [2024-02-23 01:58:02,723: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:58:02.726414420Z [2024-02-23 01:58:02,726: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:58:02.726549978Z [2024-02-23 01:58:02,726: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:58:02.726808156Z [2024-02-23 01:58:02,726: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:58:02.727097966Z [2024-02-23 01:58:02,726: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:58:02.727552958Z [2024-02-23 01:58:02,727: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:58:02.727685427Z [2024-02-23 01:58:02,727: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:58:02.779556521Z [2024-02-23 01:58:02,779: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:58:02.845035831Z [2024-02-23 01:58:02,844: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:58:04.763009160Z [2024-02-23 01:58:04,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39c65856-2257-4371-bae3-b164e6fbc088] succeeded in 3.8473622890014667s: None 2024-02-23T01:58:04.879553485Z [2024-02-23 01:58:04,878: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2497fa5-b9b9-4000-be7a-255b96cbfb0e] succeeded in 3.969358877000559s: None 2024-02-23T01:59:00.821728254Z [2024-02-23 01:59:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56597cae-639c-4b78-9e3f-44229b0c1e4c] received 2024-02-23T01:59:00.825125132Z [2024-02-23 01:59:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9c62c68-39d1-49e9-b37d-f8d007c3394d] received 2024-02-23T01:59:00.828405655Z [2024-02-23 01:59:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46cd36d8-619f-48f9-9ad4-e74fb6694dee] received 2024-02-23T01:59:00.835812763Z [2024-02-23 01:59:00,835: INFO/ForkPoolWorker-15] [56597cae-639c-4b78-9e3f-44229b0c1e4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T01:59:00.838810758Z [2024-02-23 01:59:00,838: INFO/ForkPoolWorker-16] [c9c62c68-39d1-49e9-b37d-f8d007c3394d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T01:59:00.839298829Z [2024-02-23 01:59:00,839: INFO/ForkPoolWorker-1] [46cd36d8-619f-48f9-9ad4-e74fb6694dee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T01:59:01.142699407Z [2024-02-23 01:59:01,139: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T01:59:01.145718498Z [2024-02-23 01:59:01,142: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T01:59:01.166088592Z [2024-02-23 01:59:01,163: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T01:59:01.298359937Z [2024-02-23 01:59:01,297: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T01:59:01.305342217Z [2024-02-23 01:59:01,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:59:01.334330872Z [2024-02-23 01:59:01,334: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T01:59:01.335751765Z [2024-02-23 01:59:01,335: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T01:59:01.336013083Z [2024-02-23 01:59:01,335: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T01:59:01.336105781Z [2024-02-23 01:59:01,335: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T01:59:01.336420031Z [2024-02-23 01:59:01,336: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T01:59:01.443956965Z [2024-02-23 01:59:01,443: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:59:02.133707248Z [2024-02-23 01:59:02,133: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46cd36d8-619f-48f9-9ad4-e74fb6694dee] succeeded in 1.3037254570008372s: None 2024-02-23T01:59:02.347501553Z [2024-02-23 01:59:02,347: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T01:59:02.351072346Z [2024-02-23 01:59:02,350: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:59:02.354676789Z [2024-02-23 01:59:02,354: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T01:59:02.359074584Z [2024-02-23 01:59:02,358: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T01:59:02.378196859Z [2024-02-23 01:59:02,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T01:59:02.380533204Z [2024-02-23 01:59:02,380: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:59:02.380775585Z [2024-02-23 01:59:02,380: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:59:02.381313868Z [2024-02-23 01:59:02,381: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:59:02.382896207Z [2024-02-23 01:59:02,382: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T01:59:02.383323452Z [2024-02-23 01:59:02,383: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T01:59:02.384356893Z [2024-02-23 01:59:02,384: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:59:02.386304272Z [2024-02-23 01:59:02,385: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T01:59:02.389783897Z [2024-02-23 01:59:02,389: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T01:59:02.390672843Z [2024-02-23 01:59:02,390: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T01:59:02.391428038Z [2024-02-23 01:59:02,391: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T01:59:02.391744905Z [2024-02-23 01:59:02,391: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T01:59:02.392377939Z [2024-02-23 01:59:02,392: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T01:59:02.392568905Z [2024-02-23 01:59:02,392: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T01:59:02.498126970Z [2024-02-23 01:59:02,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:59:02.508216947Z [2024-02-23 01:59:02,507: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T01:59:04.230641082Z [2024-02-23 01:59:04,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9c62c68-39d1-49e9-b37d-f8d007c3394d] succeeded in 3.4008658789989568s: None 2024-02-23T01:59:04.522618603Z [2024-02-23 01:59:04,521: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56597cae-639c-4b78-9e3f-44229b0c1e4c] succeeded in 3.698088232998998s: None 2024-02-23T02:00:00.767895982Z [2024-02-23 02:00:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65fda27c-1b1c-4333-8abb-745658bad36c] received 2024-02-23T02:00:00.772320030Z [2024-02-23 02:00:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae4811f6-c503-4a69-8e03-41413725a91b] received 2024-02-23T02:00:00.778552778Z [2024-02-23 02:00:00,778: INFO/ForkPoolWorker-16] [ae4811f6-c503-4a69-8e03-41413725a91b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:00:00.788998352Z [2024-02-23 02:00:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a47059e-f3d2-4c8f-b9c1-08fab21a819e] received 2024-02-23T02:00:00.790016546Z [2024-02-23 02:00:00,789: INFO/ForkPoolWorker-15] [65fda27c-1b1c-4333-8abb-745658bad36c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:00:00.791222259Z [2024-02-23 02:00:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcaf0f91-2759-4ea2-922b-d2d4a33f5cad] received 2024-02-23T02:00:00.795157912Z [2024-02-23 02:00:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73252a7c-69c9-4c55-8b45-095b632053c9] received 2024-02-23T02:00:00.797217753Z [2024-02-23 02:00:00,797: INFO/ForkPoolWorker-1] [7a47059e-f3d2-4c8f-b9c1-08fab21a819e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:00:00.799653440Z [2024-02-23 02:00:00,799: INFO/ForkPoolWorker-2] [dcaf0f91-2759-4ea2-922b-d2d4a33f5cad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:00:00.826555677Z [2024-02-23 02:00:00,826: INFO/ForkPoolWorker-3] [73252a7c-69c9-4c55-8b45-095b632053c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:00:01.149017932Z [2024-02-23 02:00:01,143: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:00:01.189556763Z [2024-02-23 02:00:01,186: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:00:01.263275377Z [2024-02-23 02:00:01,255: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:00:01.304953774Z [2024-02-23 02:00:01,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:00:01.363602081Z [2024-02-23 02:00:01,363: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T02:00:01.370933219Z [2024-02-23 02:00:01,370: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:01.375181438Z [2024-02-23 02:00:01,362: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:00:01.445310710Z [2024-02-23 02:00:01,445: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:00:01.471519486Z [2024-02-23 02:00:01,471: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:00:01.471970883Z [2024-02-23 02:00:01,471: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:00:01.472111681Z [2024-02-23 02:00:01,471: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T02:00:01.472611155Z [2024-02-23 02:00:01,472: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:00:01.647567282Z [2024-02-23 02:00:01,647: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:01.828091620Z [2024-02-23 02:00:01,827: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:02.458740883Z [2024-02-23 02:00:02,458: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[73252a7c-69c9-4c55-8b45-095b632053c9] succeeded in 1.657269149000058s: None 2024-02-23T02:00:02.787926781Z [2024-02-23 02:00:02,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae4811f6-c503-4a69-8e03-41413725a91b] succeeded in 2.0140457470006368s: None 2024-02-23T02:00:03.028925525Z [2024-02-23 02:00:03,028: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:00:03.032454754Z [2024-02-23 02:00:03,031: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:03.057868362Z [2024-02-23 02:00:03,057: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:00:03.060495554Z [2024-02-23 02:00:03,060: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:00:03.060978354Z [2024-02-23 02:00:03,060: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:00:03.061582738Z [2024-02-23 02:00:03,061: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:00:03.062042616Z [2024-02-23 02:00:03,061: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:00:03.063078762Z [2024-02-23 02:00:03,062: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:00:03.063452362Z [2024-02-23 02:00:03,063: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:00:03.086523410Z [2024-02-23 02:00:03,086: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:00:03.091377679Z [2024-02-23 02:00:03,090: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:03.112000016Z [2024-02-23 02:00:03,111: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:00:03.113298503Z [2024-02-23 02:00:03,113: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:00:03.113336639Z [2024-02-23 02:00:03,113: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:00:03.113570477Z [2024-02-23 02:00:03,113: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:00:03.113736386Z [2024-02-23 02:00:03,113: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:00:03.114058031Z [2024-02-23 02:00:03,113: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:00:03.114138704Z [2024-02-23 02:00:03,114: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:00:03.203663730Z [2024-02-23 02:00:03,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:03.238730204Z [2024-02-23 02:00:03,237: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:03.243515177Z [2024-02-23 02:00:03,243: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:00:03.247775400Z [2024-02-23 02:00:03,247: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:03.271642691Z [2024-02-23 02:00:03,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:00:03.274279080Z [2024-02-23 02:00:03,273: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:00:03.274322238Z [2024-02-23 02:00:03,274: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:00:03.274631193Z [2024-02-23 02:00:03,274: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:00:03.274766460Z [2024-02-23 02:00:03,274: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:00:03.275169592Z [2024-02-23 02:00:03,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:00:03.275188473Z [2024-02-23 02:00:03,275: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:00:03.377939227Z [2024-02-23 02:00:03,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:04.066053200Z [2024-02-23 02:00:04,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65fda27c-1b1c-4333-8abb-745658bad36c] succeeded in 3.2933356980011013s: None 2024-02-23T02:00:04.810920591Z [2024-02-23 02:00:04,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f72540de-7db4-43af-af49-7bdb698b77f8] received 2024-02-23T02:00:04.818347690Z [2024-02-23 02:00:04,818: INFO/ForkPoolWorker-15] [f72540de-7db4-43af-af49-7bdb698b77f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:00:04.912080437Z [2024-02-23 02:00:04,911: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dcaf0f91-2759-4ea2-922b-d2d4a33f5cad] succeeded in 4.119310840000253s: None 2024-02-23T02:00:05.136517213Z [2024-02-23 02:00:05,133: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:00:05.447651642Z [2024-02-23 02:00:05,447: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a47059e-f3d2-4c8f-b9c1-08fab21a819e] succeeded in 4.655155160000504s: None 2024-02-23T02:00:06.317648632Z [2024-02-23 02:00:06,317: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:00:06.321140589Z [2024-02-23 02:00:06,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:06.341441613Z [2024-02-23 02:00:06,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:00:06.342996983Z [2024-02-23 02:00:06,342: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:00:06.343193330Z [2024-02-23 02:00:06,342: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:00:06.343416507Z [2024-02-23 02:00:06,343: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:00:06.343579930Z [2024-02-23 02:00:06,343: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:00:06.343938162Z [2024-02-23 02:00:06,343: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:00:06.344072334Z [2024-02-23 02:00:06,343: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:00:06.435143814Z [2024-02-23 02:00:06,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:07.062956202Z [2024-02-23 02:00:07,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f72540de-7db4-43af-af49-7bdb698b77f8] succeeded in 2.25010426299923s: None 2024-02-23T02:00:07.263197994Z [2024-02-23 02:00:07,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60bd4cc3-5dbd-4868-83c4-00b4a9fae9f3] received 2024-02-23T02:00:07.270763378Z [2024-02-23 02:00:07,269: INFO/ForkPoolWorker-15] [60bd4cc3-5dbd-4868-83c4-00b4a9fae9f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:00:07.552418859Z [2024-02-23 02:00:07,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:00:08.675240985Z [2024-02-23 02:00:08,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:00:08.678435746Z [2024-02-23 02:00:08,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:08.703221874Z [2024-02-23 02:00:08,702: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:00:08.705635024Z [2024-02-23 02:00:08,705: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:00:08.705688513Z [2024-02-23 02:00:08,705: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:00:08.705763992Z [2024-02-23 02:00:08,705: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:00:08.705829693Z [2024-02-23 02:00:08,705: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:00:08.706113010Z [2024-02-23 02:00:08,705: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:00:08.706144319Z [2024-02-23 02:00:08,706: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:00:08.797690230Z [2024-02-23 02:00:08,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:09.397758808Z [2024-02-23 02:00:09,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60bd4cc3-5dbd-4868-83c4-00b4a9fae9f3] succeeded in 2.1329243370000768s: None 2024-02-23T02:00:09.869597767Z [2024-02-23 02:00:09,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fe2b9a5-f971-4dfe-a09f-baa6a6f2fb27] received 2024-02-23T02:00:09.877505636Z [2024-02-23 02:00:09,877: INFO/ForkPoolWorker-15] [4fe2b9a5-f971-4dfe-a09f-baa6a6f2fb27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:00:10.185114124Z [2024-02-23 02:00:10,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:00:11.243118697Z [2024-02-23 02:00:11,242: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:00:11.246401002Z [2024-02-23 02:00:11,245: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:00:11.271465052Z [2024-02-23 02:00:11,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:00:11.273120755Z [2024-02-23 02:00:11,272: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:00:11.273326212Z [2024-02-23 02:00:11,273: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:00:11.273511935Z [2024-02-23 02:00:11,273: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:00:11.273628461Z [2024-02-23 02:00:11,273: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:00:11.274224751Z [2024-02-23 02:00:11,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:00:11.274292575Z [2024-02-23 02:00:11,274: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:00:11.374216065Z [2024-02-23 02:00:11,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:00:11.944894239Z [2024-02-23 02:00:11,944: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4fe2b9a5-f971-4dfe-a09f-baa6a6f2fb27] succeeded in 2.072858681998696s: None 2024-02-23T02:01:00.655790431Z [2024-02-23 02:01:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6d8669d-bc29-466f-8cf0-be10926e0a0c] received 2024-02-23T02:01:00.658644848Z [2024-02-23 02:01:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[045abfd9-88c3-42f3-aec3-59e07f8ca4d6] received 2024-02-23T02:01:00.667324100Z [2024-02-23 02:01:00,667: INFO/ForkPoolWorker-15] [f6d8669d-bc29-466f-8cf0-be10926e0a0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:01:00.672048678Z [2024-02-23 02:01:00,671: INFO/ForkPoolWorker-16] [045abfd9-88c3-42f3-aec3-59e07f8ca4d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:01:00.672083482Z [2024-02-23 02:01:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf94d578-f967-40b7-915c-73773caee8a2] received 2024-02-23T02:01:00.680062300Z [2024-02-23 02:01:00,679: INFO/ForkPoolWorker-1] [bf94d578-f967-40b7-915c-73773caee8a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:01:00.960813272Z [2024-02-23 02:01:00,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:01:01.004444936Z [2024-02-23 02:01:00,998: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:01:01.067317823Z [2024-02-23 02:01:01,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:01:01.169876226Z [2024-02-23 02:01:01,169: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:01:01.177682987Z [2024-02-23 02:01:01,173: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:01:01.200993312Z [2024-02-23 02:01:01,200: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:01:01.202122713Z [2024-02-23 02:01:01,201: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:01:01.202358081Z [2024-02-23 02:01:01,202: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:01:01.202531897Z [2024-02-23 02:01:01,202: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:01:01.203216118Z [2024-02-23 02:01:01,203: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:01:01.291278452Z [2024-02-23 02:01:01,291: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:01:02.029326058Z [2024-02-23 02:01:02,028: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf94d578-f967-40b7-915c-73773caee8a2] succeeded in 1.3551119139992807s: None 2024-02-23T02:01:02.365931153Z [2024-02-23 02:01:02,365: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:01:02.369232751Z [2024-02-23 02:01:02,368: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:01:02.374944680Z [2024-02-23 02:01:02,374: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:01:02.379315784Z [2024-02-23 02:01:02,378: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:01:02.387250972Z [2024-02-23 02:01:02,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:01:02.388421497Z [2024-02-23 02:01:02,388: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:01:02.388459665Z [2024-02-23 02:01:02,388: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:01:02.388550435Z [2024-02-23 02:01:02,388: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:01:02.388583285Z [2024-02-23 02:01:02,388: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:01:02.388808337Z [2024-02-23 02:01:02,388: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:01:02.388820970Z [2024-02-23 02:01:02,388: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:01:02.401372201Z [2024-02-23 02:01:02,401: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:01:02.403240489Z [2024-02-23 02:01:02,403: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:01:02.403304819Z [2024-02-23 02:01:02,403: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:01:02.403517697Z [2024-02-23 02:01:02,403: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:01:02.403630269Z [2024-02-23 02:01:02,403: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:01:02.403942026Z [2024-02-23 02:01:02,403: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:01:02.404039646Z [2024-02-23 02:01:02,403: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:01:02.475734354Z [2024-02-23 02:01:02,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:01:02.498091472Z [2024-02-23 02:01:02,497: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:01:04.041854361Z [2024-02-23 02:01:04,041: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[045abfd9-88c3-42f3-aec3-59e07f8ca4d6] succeeded in 3.3804322779997165s: None 2024-02-23T02:01:04.453480819Z [2024-02-23 02:01:04,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6d8669d-bc29-466f-8cf0-be10926e0a0c] succeeded in 3.7957348370000545s: None 2024-02-23T02:02:00.414777642Z [2024-02-23 02:02:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a3afd11-ec8c-4b4a-ae8d-6f43d67480d1] received 2024-02-23T02:02:00.419308805Z [2024-02-23 02:02:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d5c8ebe-dff5-44fa-ab4c-54cbd7e964fe] received 2024-02-23T02:02:00.421763478Z [2024-02-23 02:02:00,421: INFO/ForkPoolWorker-15] [1a3afd11-ec8c-4b4a-ae8d-6f43d67480d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:02:00.425835677Z [2024-02-23 02:02:00,425: INFO/ForkPoolWorker-16] [3d5c8ebe-dff5-44fa-ab4c-54cbd7e964fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:02:00.428881443Z [2024-02-23 02:02:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee6e9670-5467-4f3f-a613-c5a9edfb1b5f] received 2024-02-23T02:02:00.431329835Z [2024-02-23 02:02:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d955c24-6f4b-4545-a056-b33938c2806a] received 2024-02-23T02:02:00.439156357Z [2024-02-23 02:02:00,438: INFO/ForkPoolWorker-1] [ee6e9670-5467-4f3f-a613-c5a9edfb1b5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:02:00.445297848Z [2024-02-23 02:02:00,445: INFO/ForkPoolWorker-2] [1d955c24-6f4b-4545-a056-b33938c2806a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:02:00.739082653Z [2024-02-23 02:02:00,736: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:02:00.758891401Z [2024-02-23 02:02:00,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:02:00.782724479Z [2024-02-23 02:02:00,778: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:02:00.922090394Z [2024-02-23 02:02:00,914: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:02:00.983844286Z [2024-02-23 02:02:00,983: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:02:01.012709679Z [2024-02-23 02:02:01,011: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:02:01.015507428Z [2024-02-23 02:02:01,015: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:02:01.053253800Z [2024-02-23 02:02:01,053: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:02:01.054887933Z [2024-02-23 02:02:01,054: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:02:01.055300003Z [2024-02-23 02:02:01,054: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:02:01.055544397Z [2024-02-23 02:02:01,055: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:02:01.055891822Z [2024-02-23 02:02:01,055: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:02:01.191184038Z [2024-02-23 02:02:01,190: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:02:01.626361202Z [2024-02-23 02:02:01,625: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a3afd11-ec8c-4b4a-ae8d-6f43d67480d1] succeeded in 1.2094164550017013s: None 2024-02-23T02:02:01.815907036Z [2024-02-23 02:02:01,815: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1d955c24-6f4b-4545-a056-b33938c2806a] succeeded in 1.3822290480002266s: None 2024-02-23T02:02:02.161943180Z [2024-02-23 02:02:02,161: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:02:02.165330822Z [2024-02-23 02:02:02,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:02:02.193352509Z [2024-02-23 02:02:02,193: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:02:02.195024028Z [2024-02-23 02:02:02,194: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:02:02.195149170Z [2024-02-23 02:02:02,194: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:02:02.195340441Z [2024-02-23 02:02:02,195: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:02:02.195472366Z [2024-02-23 02:02:02,195: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:02:02.195868589Z [2024-02-23 02:02:02,195: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:02:02.195955564Z [2024-02-23 02:02:02,195: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:02:02.295083646Z [2024-02-23 02:02:02,294: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:02:02.383157456Z [2024-02-23 02:02:02,382: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:02:02.386492807Z [2024-02-23 02:02:02,385: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:02:02.415956514Z [2024-02-23 02:02:02,415: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:02:02.417525193Z [2024-02-23 02:02:02,417: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:02:02.417546660Z [2024-02-23 02:02:02,417: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:02:02.417658548Z [2024-02-23 02:02:02,417: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:02:02.417821151Z [2024-02-23 02:02:02,417: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:02:02.418145718Z [2024-02-23 02:02:02,417: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:02:02.418190098Z [2024-02-23 02:02:02,418: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:02:02.501836657Z [2024-02-23 02:02:02,501: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:02:04.040999866Z [2024-02-23 02:02:04,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ee6e9670-5467-4f3f-a613-c5a9edfb1b5f] succeeded in 3.6106739719998586s: None 2024-02-23T02:02:04.200720893Z [2024-02-23 02:02:04,200: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d5c8ebe-dff5-44fa-ab4c-54cbd7e964fe] succeeded in 3.7798498419997486s: None 2024-02-23T02:03:00.329049004Z [2024-02-23 02:03:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[430484cf-37b5-413a-93d2-ba267e2b846d] received 2024-02-23T02:03:00.333282239Z [2024-02-23 02:03:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590ba239-aef9-4ecc-8a41-d3bb5375aa10] received 2024-02-23T02:03:00.342507921Z [2024-02-23 02:03:00,342: INFO/ForkPoolWorker-16] [590ba239-aef9-4ecc-8a41-d3bb5375aa10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:03:00.342932197Z [2024-02-23 02:03:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7dd6b05-d08a-462f-8559-73071c94a8e6] received 2024-02-23T02:03:00.343621221Z [2024-02-23 02:03:00,343: INFO/ForkPoolWorker-15] [430484cf-37b5-413a-93d2-ba267e2b846d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:03:00.356681966Z [2024-02-23 02:03:00,356: INFO/ForkPoolWorker-1] [a7dd6b05-d08a-462f-8559-73071c94a8e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:03:00.629322668Z [2024-02-23 02:03:00,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:03:00.633475853Z [2024-02-23 02:03:00,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:03:00.666331759Z [2024-02-23 02:03:00,663: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:03:00.782153787Z [2024-02-23 02:03:00,781: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:03:00.786331168Z [2024-02-23 02:03:00,785: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:03:00.824188407Z [2024-02-23 02:03:00,823: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:03:00.827824517Z [2024-02-23 02:03:00,827: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:03:00.827996873Z [2024-02-23 02:03:00,827: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:03:00.828144653Z [2024-02-23 02:03:00,827: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:03:00.828464824Z [2024-02-23 02:03:00,828: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:03:00.928871874Z [2024-02-23 02:03:00,928: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:03:01.574391332Z [2024-02-23 02:03:01,573: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a7dd6b05-d08a-462f-8559-73071c94a8e6] succeeded in 1.2264493630009383s: None 2024-02-23T02:03:01.753507149Z [2024-02-23 02:03:01,753: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:03:01.757607951Z [2024-02-23 02:03:01,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:03:01.782139576Z [2024-02-23 02:03:01,781: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:03:01.784118868Z [2024-02-23 02:03:01,783: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:03:01.784178431Z [2024-02-23 02:03:01,784: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:03:01.784352926Z [2024-02-23 02:03:01,784: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:03:01.784553436Z [2024-02-23 02:03:01,784: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:03:01.784906849Z [2024-02-23 02:03:01,784: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:03:01.785150332Z [2024-02-23 02:03:01,784: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:03:01.791649500Z [2024-02-23 02:03:01,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:03:01.794955332Z [2024-02-23 02:03:01,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:03:01.817225038Z [2024-02-23 02:03:01,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:03:01.819004492Z [2024-02-23 02:03:01,818: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:03:01.819255379Z [2024-02-23 02:03:01,819: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:03:01.819486749Z [2024-02-23 02:03:01,819: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:03:01.819644650Z [2024-02-23 02:03:01,819: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:03:01.820687278Z [2024-02-23 02:03:01,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:03:01.820716394Z [2024-02-23 02:03:01,819: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:03:01.877478358Z [2024-02-23 02:03:01,877: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:03:01.916460872Z [2024-02-23 02:03:01,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:03:03.532552827Z [2024-02-23 02:03:03,532: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[590ba239-aef9-4ecc-8a41-d3bb5375aa10] succeeded in 3.1977016700002423s: None 2024-02-23T02:03:03.963740378Z [2024-02-23 02:03:03,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[430484cf-37b5-413a-93d2-ba267e2b846d] succeeded in 3.6324541459998727s: None 2024-02-23T02:04:00.947456530Z [2024-02-23 02:04:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86cfe11c-4657-4d38-9548-643c18612a64] received 2024-02-23T02:04:00.951426208Z [2024-02-23 02:04:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0348952e-074a-4fbe-8b3f-3624c2ac6c4f] received 2024-02-23T02:04:00.957312939Z [2024-02-23 02:04:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4663767-5cec-417e-b770-9ed647f1f540] received 2024-02-23T02:04:00.962351114Z [2024-02-23 02:04:00,962: INFO/ForkPoolWorker-16] [0348952e-074a-4fbe-8b3f-3624c2ac6c4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:04:00.967039221Z [2024-02-23 02:04:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[798b0c26-405a-4275-a472-703d53e04002] received 2024-02-23T02:04:00.968831036Z [2024-02-23 02:04:00,968: INFO/ForkPoolWorker-15] [86cfe11c-4657-4d38-9548-643c18612a64] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:04:00.970695535Z [2024-02-23 02:04:00,970: INFO/ForkPoolWorker-1] [b4663767-5cec-417e-b770-9ed647f1f540] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:04:00.986105903Z [2024-02-23 02:04:00,985: INFO/ForkPoolWorker-2] [798b0c26-405a-4275-a472-703d53e04002] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:04:01.463934058Z [2024-02-23 02:04:01,459: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:04:01.526587928Z [2024-02-23 02:04:01,522: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:04:01.616272557Z [2024-02-23 02:04:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:04:01.733094277Z [2024-02-23 02:04:01,732: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:04:01.739094904Z [2024-02-23 02:04:01,738: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:04:01.795848902Z [2024-02-23 02:04:01,795: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:04:01.799403698Z [2024-02-23 02:04:01,799: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:04:01.799442215Z [2024-02-23 02:04:01,799: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:04:01.803157260Z [2024-02-23 02:04:01,799: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:04:01.803469289Z [2024-02-23 02:04:01,803: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:04:01.889834835Z [2024-02-23 02:04:01,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:04:01.966669194Z [2024-02-23 02:04:01,966: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:04:02.328667771Z [2024-02-23 02:04:02,328: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:04:02.834463409Z [2024-02-23 02:04:02,834: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[798b0c26-405a-4275-a472-703d53e04002] succeeded in 1.8631401670008927s: None 2024-02-23T02:04:03.030267794Z [2024-02-23 02:04:03,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86cfe11c-4657-4d38-9548-643c18612a64] succeeded in 2.076077196999904s: None 2024-02-23T02:04:03.197830982Z [2024-02-23 02:04:03,197: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:04:03.201395821Z [2024-02-23 02:04:03,200: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:04:03.230314277Z [2024-02-23 02:04:03,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:04:03.232245460Z [2024-02-23 02:04:03,232: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:04:03.232282670Z [2024-02-23 02:04:03,232: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:04:03.232459824Z [2024-02-23 02:04:03,232: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:04:03.232472926Z [2024-02-23 02:04:03,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:04:03.232766602Z [2024-02-23 02:04:03,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:04:03.232833614Z [2024-02-23 02:04:03,232: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:04:03.356583873Z [2024-02-23 02:04:03,356: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:04:03.463137990Z [2024-02-23 02:04:03,462: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:04:03.466544958Z [2024-02-23 02:04:03,466: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:04:03.503610593Z [2024-02-23 02:04:03,503: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:04:03.506907018Z [2024-02-23 02:04:03,505: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:04:03.507146797Z [2024-02-23 02:04:03,506: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:04:03.507402586Z [2024-02-23 02:04:03,507: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:04:03.507569106Z [2024-02-23 02:04:03,507: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:04:03.508043347Z [2024-02-23 02:04:03,507: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:04:03.508222794Z [2024-02-23 02:04:03,508: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:04:03.643579622Z [2024-02-23 02:04:03,643: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:04:06.362772263Z [2024-02-23 02:04:06,362: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4663767-5cec-417e-b770-9ed647f1f540] succeeded in 5.402704124000593s: None 2024-02-23T02:04:07.069692544Z [2024-02-23 02:04:07,069: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0348952e-074a-4fbe-8b3f-3624c2ac6c4f] succeeded in 6.1159266349986865s: None 2024-02-23T02:05:01.042974220Z [2024-02-23 02:05:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f20032c-9a4e-4710-8395-ac012ff674b3] received 2024-02-23T02:05:01.047759502Z [2024-02-23 02:05:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94731494-0a1e-49df-95bb-abdf9e9634d0] received 2024-02-23T02:05:01.049520036Z [2024-02-23 02:05:01,048: INFO/ForkPoolWorker-15] [1f20032c-9a4e-4710-8395-ac012ff674b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:05:01.057767292Z [2024-02-23 02:05:01,057: INFO/ForkPoolWorker-16] [94731494-0a1e-49df-95bb-abdf9e9634d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:05:01.058646425Z [2024-02-23 02:05:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e94432d-1ffe-466f-af5d-50387bfd281e] received 2024-02-23T02:05:01.061742888Z [2024-02-23 02:05:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24edf5eb-d04e-4815-b2ec-fdfd7e072264] received 2024-02-23T02:05:01.068525379Z [2024-02-23 02:05:01,068: INFO/ForkPoolWorker-1] [5e94432d-1ffe-466f-af5d-50387bfd281e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:05:01.069809302Z [2024-02-23 02:05:01,069: INFO/ForkPoolWorker-2] [24edf5eb-d04e-4815-b2ec-fdfd7e072264] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:05:01.349405741Z [2024-02-23 02:05:01,346: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:05:01.432956921Z [2024-02-23 02:05:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:05:01.472835104Z [2024-02-23 02:05:01,469: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:05:01.520498125Z [2024-02-23 02:05:01,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:05:01.649834490Z [2024-02-23 02:05:01,649: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:05:01.655862576Z [2024-02-23 02:05:01,655: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:01.695243724Z [2024-02-23 02:05:01,694: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:05:01.697547783Z [2024-02-23 02:05:01,697: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:05:01.697739944Z [2024-02-23 02:05:01,697: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:05:01.697867662Z [2024-02-23 02:05:01,697: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:05:01.698212120Z [2024-02-23 02:05:01,698: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:05:01.837516324Z [2024-02-23 02:05:01,837: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:02.593895411Z [2024-02-23 02:05:02,593: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24edf5eb-d04e-4815-b2ec-fdfd7e072264] succeeded in 1.5296906509993278s: None 2024-02-23T02:05:02.792419642Z [2024-02-23 02:05:02,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:05:02.796082647Z [2024-02-23 02:05:02,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:02.818345721Z [2024-02-23 02:05:02,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:05:02.819979104Z [2024-02-23 02:05:02,819: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:05:02.820101451Z [2024-02-23 02:05:02,819: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:05:02.820296514Z [2024-02-23 02:05:02,820: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:05:02.820467797Z [2024-02-23 02:05:02,820: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:05:02.820784233Z [2024-02-23 02:05:02,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:05:02.821273774Z [2024-02-23 02:05:02,820: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:05:02.854838365Z [2024-02-23 02:05:02,854: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:05:02.858414246Z [2024-02-23 02:05:02,857: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:02.897138799Z [2024-02-23 02:05:02,896: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:05:02.910491476Z [2024-02-23 02:05:02,910: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:05:02.911170795Z [2024-02-23 02:05:02,910: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:05:02.911729964Z [2024-02-23 02:05:02,911: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:05:02.911910813Z [2024-02-23 02:05:02,911: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:05:02.912522269Z [2024-02-23 02:05:02,912: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:05:02.912768357Z [2024-02-23 02:05:02,912: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:05:02.938867814Z [2024-02-23 02:05:02,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:03.016186361Z [2024-02-23 02:05:03,015: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:03.103300660Z [2024-02-23 02:05:03,102: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:05:03.107589404Z [2024-02-23 02:05:03,106: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:03.146089501Z [2024-02-23 02:05:03,145: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:05:03.147856046Z [2024-02-23 02:05:03,147: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:05:03.148000867Z [2024-02-23 02:05:03,147: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:05:03.148192630Z [2024-02-23 02:05:03,147: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:05:03.148356445Z [2024-02-23 02:05:03,148: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:05:03.148671599Z [2024-02-23 02:05:03,148: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:05:03.149181164Z [2024-02-23 02:05:03,148: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:05:03.253784530Z [2024-02-23 02:05:03,253: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:03.561042151Z [2024-02-23 02:05:03,560: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f20032c-9a4e-4710-8395-ac012ff674b3] succeeded in 2.5165067260004435s: None 2024-02-23T02:05:03.700530886Z [2024-02-23 02:05:03,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe7036db-f011-431a-a536-be43272d08ba] received 2024-02-23T02:05:03.708590964Z [2024-02-23 02:05:03,708: INFO/ForkPoolWorker-15] [fe7036db-f011-431a-a536-be43272d08ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:05:04.048691175Z [2024-02-23 02:05:04,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:05:04.897765618Z [2024-02-23 02:05:04,897: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e94432d-1ffe-466f-af5d-50387bfd281e] succeeded in 3.8371805110000423s: None 2024-02-23T02:05:05.251587978Z [2024-02-23 02:05:05,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94731494-0a1e-49df-95bb-abdf9e9634d0] succeeded in 4.200978426000802s: None 2024-02-23T02:05:05.334672196Z [2024-02-23 02:05:05,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:05:05.339399511Z [2024-02-23 02:05:05,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:05.365260417Z [2024-02-23 02:05:05,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:05:05.371016150Z [2024-02-23 02:05:05,365: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:05:05.371043251Z [2024-02-23 02:05:05,366: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:05:05.371048550Z [2024-02-23 02:05:05,366: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:05:05.371052507Z [2024-02-23 02:05:05,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:05:05.371055678Z [2024-02-23 02:05:05,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:05:05.371058989Z [2024-02-23 02:05:05,366: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:05:05.467831911Z [2024-02-23 02:05:05,467: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:06.191891094Z [2024-02-23 02:05:06,191: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe7036db-f011-431a-a536-be43272d08ba] succeeded in 2.489574987001106s: None 2024-02-23T02:05:06.797321832Z [2024-02-23 02:05:06,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[284845f7-966a-43b0-a786-69f5c8c88d4e] received 2024-02-23T02:05:06.804110262Z [2024-02-23 02:05:06,803: INFO/ForkPoolWorker-15] [284845f7-966a-43b0-a786-69f5c8c88d4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:05:07.108422608Z [2024-02-23 02:05:07,105: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:05:08.216124922Z [2024-02-23 02:05:08,215: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:05:08.219211978Z [2024-02-23 02:05:08,218: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:08.241855256Z [2024-02-23 02:05:08,241: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:05:08.244457306Z [2024-02-23 02:05:08,244: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:05:08.244575557Z [2024-02-23 02:05:08,244: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:05:08.244830757Z [2024-02-23 02:05:08,244: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:05:08.244957904Z [2024-02-23 02:05:08,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:05:08.245562682Z [2024-02-23 02:05:08,245: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:05:08.245689926Z [2024-02-23 02:05:08,245: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:05:08.332397583Z [2024-02-23 02:05:08,332: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:08.877989322Z [2024-02-23 02:05:08,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d36fe38-6b37-4b80-a30f-024291c86c1e] received 2024-02-23T02:05:08.888421222Z [2024-02-23 02:05:08,888: INFO/ForkPoolWorker-16] [6d36fe38-6b37-4b80-a30f-024291c86c1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:05:08.895780639Z [2024-02-23 02:05:08,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[284845f7-966a-43b0-a786-69f5c8c88d4e] succeeded in 2.0968654490006884s: None 2024-02-23T02:05:09.146644144Z [2024-02-23 02:05:09,143: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:05:10.318492695Z [2024-02-23 02:05:10,318: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:05:10.321711646Z [2024-02-23 02:05:10,321: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:05:10.345805546Z [2024-02-23 02:05:10,345: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:05:10.347192248Z [2024-02-23 02:05:10,346: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:05:10.347215762Z [2024-02-23 02:05:10,347: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:05:10.347366106Z [2024-02-23 02:05:10,347: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:05:10.347378294Z [2024-02-23 02:05:10,347: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:05:10.347650210Z [2024-02-23 02:05:10,347: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:05:10.347665155Z [2024-02-23 02:05:10,347: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:05:10.448387085Z [2024-02-23 02:05:10,447: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:05:11.056751481Z [2024-02-23 02:05:11,056: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d36fe38-6b37-4b80-a30f-024291c86c1e] succeeded in 2.177185370999723s: None 2024-02-23T02:06:00.903957207Z [2024-02-23 02:06:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3019137f-b9ed-471e-9080-7d71a14fc2c0] received 2024-02-23T02:06:00.906153127Z [2024-02-23 02:06:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9665187-8a87-482e-af70-b1b9819137fd] received 2024-02-23T02:06:00.915961128Z [2024-02-23 02:06:00,915: INFO/ForkPoolWorker-16] [b9665187-8a87-482e-af70-b1b9819137fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:06:00.921492076Z [2024-02-23 02:06:00,921: INFO/ForkPoolWorker-15] [3019137f-b9ed-471e-9080-7d71a14fc2c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:06:00.924937096Z [2024-02-23 02:06:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[921e0572-565f-4d06-bff0-165bebf9bd46] received 2024-02-23T02:06:00.926466885Z [2024-02-23 02:06:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c0207cf-b8ec-43da-add2-f15b558900f3] received 2024-02-23T02:06:00.936740931Z [2024-02-23 02:06:00,936: INFO/ForkPoolWorker-1] [921e0572-565f-4d06-bff0-165bebf9bd46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:06:00.939656116Z [2024-02-23 02:06:00,939: INFO/ForkPoolWorker-2] [3c0207cf-b8ec-43da-add2-f15b558900f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:06:01.231505788Z [2024-02-23 02:06:01,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:06:01.283534603Z [2024-02-23 02:06:01,280: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:06:01.300788765Z [2024-02-23 02:06:01,297: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:06:01.372493426Z [2024-02-23 02:06:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:06:01.491534051Z [2024-02-23 02:06:01,491: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:06:01.495357154Z [2024-02-23 02:06:01,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:06:01.497057196Z [2024-02-23 02:06:01,496: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:06:01.529517929Z [2024-02-23 02:06:01,529: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:06:01.531862166Z [2024-02-23 02:06:01,531: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:06:01.532166638Z [2024-02-23 02:06:01,531: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:06:01.532346555Z [2024-02-23 02:06:01,532: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:06:01.533245864Z [2024-02-23 02:06:01,533: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:06:01.671545576Z [2024-02-23 02:06:01,671: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:06:02.183389167Z [2024-02-23 02:06:02,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3019137f-b9ed-471e-9080-7d71a14fc2c0] succeeded in 1.2771176360001846s: None 2024-02-23T02:06:02.282682243Z [2024-02-23 02:06:02,282: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c0207cf-b8ec-43da-add2-f15b558900f3] succeeded in 1.352131024999835s: None 2024-02-23T02:06:02.539653435Z [2024-02-23 02:06:02,539: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:06:02.543313266Z [2024-02-23 02:06:02,542: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:06:02.572052942Z [2024-02-23 02:06:02,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:06:02.580152956Z [2024-02-23 02:06:02,579: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:06:02.580406523Z [2024-02-23 02:06:02,580: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:06:02.580638534Z [2024-02-23 02:06:02,580: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:06:02.580798101Z [2024-02-23 02:06:02,580: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:06:02.581263451Z [2024-02-23 02:06:02,581: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:06:02.581408897Z [2024-02-23 02:06:02,581: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:06:02.662328525Z [2024-02-23 02:06:02,661: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:06:02.695489390Z [2024-02-23 02:06:02,695: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:06:02.698633548Z [2024-02-23 02:06:02,698: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:06:02.723886838Z [2024-02-23 02:06:02,723: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:06:02.726470495Z [2024-02-23 02:06:02,726: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:06:02.726522181Z [2024-02-23 02:06:02,726: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:06:02.726712966Z [2024-02-23 02:06:02,726: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:06:02.726757246Z [2024-02-23 02:06:02,726: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:06:02.727153440Z [2024-02-23 02:06:02,726: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:06:02.727358332Z [2024-02-23 02:06:02,727: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:06:02.803865445Z [2024-02-23 02:06:02,803: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:06:04.439205714Z [2024-02-23 02:06:04,438: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[921e0572-565f-4d06-bff0-165bebf9bd46] succeeded in 3.511517213000843s: None 2024-02-23T02:06:04.497153875Z [2024-02-23 02:06:04,496: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b9665187-8a87-482e-af70-b1b9819137fd] succeeded in 3.588526396999441s: None 2024-02-23T02:07:00.425988363Z [2024-02-23 02:07:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efdb92f4-27f5-4e48-be0a-df1ca933b4d9] received 2024-02-23T02:07:00.433870911Z [2024-02-23 02:07:00,433: INFO/ForkPoolWorker-15] [efdb92f4-27f5-4e48-be0a-df1ca933b4d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:07:00.439328079Z [2024-02-23 02:07:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8f1d0a1-8320-4f6a-b033-42728248fc0e] received 2024-02-23T02:07:00.441268121Z [2024-02-23 02:07:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[447d091e-f534-49a4-af54-f1d3520b4244] received 2024-02-23T02:07:00.447591025Z [2024-02-23 02:07:00,447: INFO/ForkPoolWorker-1] [447d091e-f534-49a4-af54-f1d3520b4244] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:07:00.448242748Z [2024-02-23 02:07:00,448: INFO/ForkPoolWorker-16] [e8f1d0a1-8320-4f6a-b033-42728248fc0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:07:00.729921062Z [2024-02-23 02:07:00,727: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:07:00.742672945Z [2024-02-23 02:07:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:07:00.789747171Z [2024-02-23 02:07:00,786: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:07:00.938154765Z [2024-02-23 02:07:00,937: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:07:00.941985653Z [2024-02-23 02:07:00,941: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:07:00.965434665Z [2024-02-23 02:07:00,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:07:00.966678995Z [2024-02-23 02:07:00,966: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:07:00.966741821Z [2024-02-23 02:07:00,966: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:07:00.966792271Z [2024-02-23 02:07:00,966: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:07:00.967039231Z [2024-02-23 02:07:00,966: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:07:01.058724266Z [2024-02-23 02:07:01,058: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:07:01.650153826Z [2024-02-23 02:07:01,649: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8f1d0a1-8320-4f6a-b033-42728248fc0e] succeeded in 1.2096888600008242s: None 2024-02-23T02:07:01.840934959Z [2024-02-23 02:07:01,840: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:07:01.844220490Z [2024-02-23 02:07:01,843: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:07:01.865253811Z [2024-02-23 02:07:01,865: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:07:01.869231994Z [2024-02-23 02:07:01,868: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:07:01.869252938Z [2024-02-23 02:07:01,869: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:07:01.869397400Z [2024-02-23 02:07:01,869: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:07:01.869539107Z [2024-02-23 02:07:01,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:07:01.869825570Z [2024-02-23 02:07:01,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:07:01.869936746Z [2024-02-23 02:07:01,869: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:07:01.957418364Z [2024-02-23 02:07:01,957: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:07:02.058426020Z [2024-02-23 02:07:02,058: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:07:02.061928769Z [2024-02-23 02:07:02,061: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:07:02.086785801Z [2024-02-23 02:07:02,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:07:02.088544862Z [2024-02-23 02:07:02,088: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:07:02.088670031Z [2024-02-23 02:07:02,088: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:07:02.088920161Z [2024-02-23 02:07:02,088: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:07:02.089052589Z [2024-02-23 02:07:02,088: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:07:02.089647032Z [2024-02-23 02:07:02,089: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:07:02.089659204Z [2024-02-23 02:07:02,089: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:07:02.232116152Z [2024-02-23 02:07:02,231: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:07:03.856199967Z [2024-02-23 02:07:03,855: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[447d091e-f534-49a4-af54-f1d3520b4244] succeeded in 3.413407650001318s: None 2024-02-23T02:07:04.035907241Z [2024-02-23 02:07:04,035: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[efdb92f4-27f5-4e48-be0a-df1ca933b4d9] succeeded in 3.6077364180000586s: None 2024-02-23T02:08:00.667397335Z [2024-02-23 02:08:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2741522-58ac-413f-8276-91631635c86c] received 2024-02-23T02:08:00.669347879Z [2024-02-23 02:08:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31e20fae-4044-481c-be0b-e36d1652de6c] received 2024-02-23T02:08:00.673373714Z [2024-02-23 02:08:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2d533dd-dd9c-4e24-b6a3-1c608a12d3d6] received 2024-02-23T02:08:00.674995985Z [2024-02-23 02:08:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ab0381c-fb8f-4471-8b02-94d4c46eb333] received 2024-02-23T02:08:00.680853027Z [2024-02-23 02:08:00,680: INFO/ForkPoolWorker-1] [d2d533dd-dd9c-4e24-b6a3-1c608a12d3d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:08:00.681396589Z [2024-02-23 02:08:00,680: INFO/ForkPoolWorker-15] [c2741522-58ac-413f-8276-91631635c86c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:08:00.682680208Z [2024-02-23 02:08:00,682: INFO/ForkPoolWorker-2] [2ab0381c-fb8f-4471-8b02-94d4c46eb333] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:08:00.690207769Z [2024-02-23 02:08:00,689: INFO/ForkPoolWorker-16] [31e20fae-4044-481c-be0b-e36d1652de6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:08:01.011171854Z [2024-02-23 02:08:01,008: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:08:01.011706672Z [2024-02-23 02:08:01,008: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:08:01.022121273Z [2024-02-23 02:08:01,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:08:01.053660052Z [2024-02-23 02:08:01,050: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:08:01.172186469Z [2024-02-23 02:08:01,171: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:08:01.177417434Z [2024-02-23 02:08:01,176: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:08:01.225156362Z [2024-02-23 02:08:01,224: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:08:01.229666645Z [2024-02-23 02:08:01,229: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:08:01.229788579Z [2024-02-23 02:08:01,229: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:08:01.230089798Z [2024-02-23 02:08:01,229: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:08:01.230410369Z [2024-02-23 02:08:01,230: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:08:01.345893203Z [2024-02-23 02:08:01,345: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:08:01.425215786Z [2024-02-23 02:08:01,424: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:08:02.033765210Z [2024-02-23 02:08:02,033: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ab0381c-fb8f-4471-8b02-94d4c46eb333] succeeded in 1.3565352389996406s: None 2024-02-23T02:08:02.118109171Z [2024-02-23 02:08:02,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2741522-58ac-413f-8276-91631635c86c] succeeded in 1.4480866129997594s: None 2024-02-23T02:08:02.319097192Z [2024-02-23 02:08:02,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:08:02.323113962Z [2024-02-23 02:08:02,322: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:08:02.358890144Z [2024-02-23 02:08:02,358: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:08:02.361095736Z [2024-02-23 02:08:02,360: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:08:02.361282080Z [2024-02-23 02:08:02,360: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:08:02.361798056Z [2024-02-23 02:08:02,361: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:08:02.362051316Z [2024-02-23 02:08:02,361: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:08:02.362801961Z [2024-02-23 02:08:02,362: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:08:02.363347405Z [2024-02-23 02:08:02,362: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:08:02.378536661Z [2024-02-23 02:08:02,378: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:08:02.382192361Z [2024-02-23 02:08:02,381: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:08:02.401865509Z [2024-02-23 02:08:02,401: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:08:02.403107443Z [2024-02-23 02:08:02,402: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:08:02.403216009Z [2024-02-23 02:08:02,402: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:08:02.403249393Z [2024-02-23 02:08:02,403: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:08:02.403285439Z [2024-02-23 02:08:02,403: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:08:02.403467756Z [2024-02-23 02:08:02,403: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:08:02.403487995Z [2024-02-23 02:08:02,403: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:08:02.486288160Z [2024-02-23 02:08:02,485: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:08:02.495287129Z [2024-02-23 02:08:02,494: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:08:04.107129327Z [2024-02-23 02:08:04,106: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2d533dd-dd9c-4e24-b6a3-1c608a12d3d6] succeeded in 3.432549495000785s: None 2024-02-23T02:08:04.349659833Z [2024-02-23 02:08:04,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31e20fae-4044-481c-be0b-e36d1652de6c] succeeded in 3.6699475750010606s: None 2024-02-23T02:09:01.010021701Z [2024-02-23 02:09:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6666734f-5ec2-491f-9106-c99daac7d7a3] received 2024-02-23T02:09:01.016374247Z [2024-02-23 02:09:01,016: INFO/ForkPoolWorker-15] [6666734f-5ec2-491f-9106-c99daac7d7a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:09:01.024791891Z [2024-02-23 02:09:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfa8fca6-63d4-4197-b049-a86caea34bb2] received 2024-02-23T02:09:01.031358340Z [2024-02-23 02:09:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d498f3fc-9030-4f95-b335-94cc2b58ad73] received 2024-02-23T02:09:01.032000792Z [2024-02-23 02:09:01,031: INFO/ForkPoolWorker-16] [bfa8fca6-63d4-4197-b049-a86caea34bb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:09:01.048089512Z [2024-02-23 02:09:01,047: INFO/ForkPoolWorker-1] [d498f3fc-9030-4f95-b335-94cc2b58ad73] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:09:01.351788456Z [2024-02-23 02:09:01,348: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:09:01.369104580Z [2024-02-23 02:09:01,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:09:01.381650939Z [2024-02-23 02:09:01,378: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:09:01.550586422Z [2024-02-23 02:09:01,550: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:09:01.554600709Z [2024-02-23 02:09:01,554: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:09:01.580294958Z [2024-02-23 02:09:01,579: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:09:01.582265563Z [2024-02-23 02:09:01,581: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:09:01.582597659Z [2024-02-23 02:09:01,582: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:09:01.582743584Z [2024-02-23 02:09:01,582: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:09:01.583248788Z [2024-02-23 02:09:01,583: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:09:01.700267105Z [2024-02-23 02:09:01,699: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:09:02.315786946Z [2024-02-23 02:09:02,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d498f3fc-9030-4f95-b335-94cc2b58ad73] succeeded in 1.276427009001054s: None 2024-02-23T02:09:03.034238828Z [2024-02-23 02:09:03,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:09:03.047059284Z [2024-02-23 02:09:03,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:09:03.069202766Z [2024-02-23 02:09:03,068: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:09:03.070536437Z [2024-02-23 02:09:03,070: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:09:03.070557368Z [2024-02-23 02:09:03,070: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:09:03.070789385Z [2024-02-23 02:09:03,070: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:09:03.070801624Z [2024-02-23 02:09:03,070: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:09:03.071063130Z [2024-02-23 02:09:03,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:09:03.071079653Z [2024-02-23 02:09:03,070: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:09:03.076975116Z [2024-02-23 02:09:03,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:09:03.080828773Z [2024-02-23 02:09:03,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:09:03.117020300Z [2024-02-23 02:09:03,116: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:09:03.119120168Z [2024-02-23 02:09:03,118: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:09:03.119280483Z [2024-02-23 02:09:03,119: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:09:03.119664600Z [2024-02-23 02:09:03,119: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:09:03.119823187Z [2024-02-23 02:09:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:09:03.120370981Z [2024-02-23 02:09:03,120: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:09:03.120529539Z [2024-02-23 02:09:03,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:09:03.187163398Z [2024-02-23 02:09:03,186: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:09:03.222366755Z [2024-02-23 02:09:03,222: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:09:05.911501977Z [2024-02-23 02:09:05,910: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6666734f-5ec2-491f-9106-c99daac7d7a3] succeeded in 4.899437233001663s: None 2024-02-23T02:09:07.159670589Z [2024-02-23 02:09:07,159: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfa8fca6-63d4-4197-b049-a86caea34bb2] succeeded in 6.133527469999535s: None 2024-02-23T02:10:01.359479894Z [2024-02-23 02:10:01,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8552da4f-7a5b-4350-b58e-a30ad775eb6f] received 2024-02-23T02:10:01.361185973Z [2024-02-23 02:10:01,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6783506-e832-410c-88b6-afb7d23158be] received 2024-02-23T02:10:01.366268509Z [2024-02-23 02:10:01,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a32b153-d531-4c82-bc53-6a07515ab611] received 2024-02-23T02:10:01.373913091Z [2024-02-23 02:10:01,373: INFO/ForkPoolWorker-1] [5a32b153-d531-4c82-bc53-6a07515ab611] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:10:01.374607038Z [2024-02-23 02:10:01,374: INFO/ForkPoolWorker-16] [f6783506-e832-410c-88b6-afb7d23158be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:10:01.375204541Z [2024-02-23 02:10:01,375: INFO/ForkPoolWorker-15] [8552da4f-7a5b-4350-b58e-a30ad775eb6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:10:01.383546867Z [2024-02-23 02:10:01,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[039e064b-5214-416c-a346-fc46b489940b] received 2024-02-23T02:10:01.391610288Z [2024-02-23 02:10:01,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b2ee021-dc14-47d6-8ea4-b82636ca08c4] received 2024-02-23T02:10:01.397258648Z [2024-02-23 02:10:01,397: INFO/ForkPoolWorker-2] [039e064b-5214-416c-a346-fc46b489940b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:10:01.406688181Z [2024-02-23 02:10:01,406: INFO/ForkPoolWorker-3] [5b2ee021-dc14-47d6-8ea4-b82636ca08c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:10:01.784107819Z [2024-02-23 02:10:01,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:10:01.819793863Z [2024-02-23 02:10:01,816: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:10:01.877277689Z [2024-02-23 02:10:01,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:10:01.994621410Z [2024-02-23 02:10:01,990: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:10:02.055519621Z [2024-02-23 02:10:02,047: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:10:02.132092897Z [2024-02-23 02:10:02,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:02.277160363Z [2024-02-23 02:10:02,276: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:10:02.283920364Z [2024-02-23 02:10:02,283: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:02.318258523Z [2024-02-23 02:10:02,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:10:02.321003797Z [2024-02-23 02:10:02,320: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:10:02.321270130Z [2024-02-23 02:10:02,320: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:10:02.321407657Z [2024-02-23 02:10:02,321: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:10:02.321984228Z [2024-02-23 02:10:02,321: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:10:02.430501844Z [2024-02-23 02:10:02,430: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:02.776768636Z [2024-02-23 02:10:02,776: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6783506-e832-410c-88b6-afb7d23158be] succeeded in 1.4122034109986998s: None 2024-02-23T02:10:03.078086203Z [2024-02-23 02:10:03,077: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a32b153-d531-4c82-bc53-6a07515ab611] succeeded in 1.7099159070003225s: None 2024-02-23T02:10:03.402442981Z [2024-02-23 02:10:03,402: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:10:03.406354250Z [2024-02-23 02:10:03,405: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:03.428838279Z [2024-02-23 02:10:03,428: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:10:03.430021600Z [2024-02-23 02:10:03,429: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:10:03.430065077Z [2024-02-23 02:10:03,429: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:10:03.430089460Z [2024-02-23 02:10:03,429: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:10:03.430173109Z [2024-02-23 02:10:03,430: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:10:03.430385608Z [2024-02-23 02:10:03,430: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:10:03.430399105Z [2024-02-23 02:10:03,430: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:10:03.472287952Z [2024-02-23 02:10:03,471: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:10:03.475742087Z [2024-02-23 02:10:03,475: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:03.505344291Z [2024-02-23 02:10:03,505: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:10:03.507027551Z [2024-02-23 02:10:03,506: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:10:03.507055729Z [2024-02-23 02:10:03,506: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:10:03.507267716Z [2024-02-23 02:10:03,507: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:10:03.507316756Z [2024-02-23 02:10:03,507: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:10:03.507697580Z [2024-02-23 02:10:03,507: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:10:03.507773921Z [2024-02-23 02:10:03,507: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:10:03.524104077Z [2024-02-23 02:10:03,523: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:03.543591422Z [2024-02-23 02:10:03,541: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T02:10:03.549124438Z [2024-02-23 02:10:03,548: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:03.585702060Z [2024-02-23 02:10:03,584: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:10:03.588452753Z [2024-02-23 02:10:03,588: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:10:03.588621081Z [2024-02-23 02:10:03,588: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:10:03.588909766Z [2024-02-23 02:10:03,588: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:10:03.589146068Z [2024-02-23 02:10:03,588: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T02:10:03.589594451Z [2024-02-23 02:10:03,589: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:10:03.591473103Z [2024-02-23 02:10:03,591: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:10:03.630216046Z [2024-02-23 02:10:03,629: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:03.712604676Z [2024-02-23 02:10:03,712: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:04.364048104Z [2024-02-23 02:10:04,363: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8552da4f-7a5b-4350-b58e-a30ad775eb6f] succeeded in 3.001697347001027s: None 2024-02-23T02:10:05.116191756Z [2024-02-23 02:10:05,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de7b04d-8161-4acf-a105-30fa708ccd38] received 2024-02-23T02:10:05.127990518Z [2024-02-23 02:10:05,127: INFO/ForkPoolWorker-15] [5de7b04d-8161-4acf-a105-30fa708ccd38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:10:05.288930290Z [2024-02-23 02:10:05,288: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5b2ee021-dc14-47d6-8ea4-b82636ca08c4] succeeded in 3.8902662600012263s: None 2024-02-23T02:10:05.487156283Z [2024-02-23 02:10:05,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:10:05.558652176Z [2024-02-23 02:10:05,558: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[039e064b-5214-416c-a346-fc46b489940b] succeeded in 4.1658995210000285s: None 2024-02-23T02:10:06.672120360Z [2024-02-23 02:10:06,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:10:06.675491936Z [2024-02-23 02:10:06,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:06.704974692Z [2024-02-23 02:10:06,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:10:06.706574974Z [2024-02-23 02:10:06,706: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:10:06.706710999Z [2024-02-23 02:10:06,706: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:10:06.707002775Z [2024-02-23 02:10:06,706: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:10:06.707118174Z [2024-02-23 02:10:06,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:10:06.707441595Z [2024-02-23 02:10:06,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:10:06.707582640Z [2024-02-23 02:10:06,707: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:10:06.814261491Z [2024-02-23 02:10:06,813: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:07.476291687Z [2024-02-23 02:10:07,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5de7b04d-8161-4acf-a105-30fa708ccd38] succeeded in 2.356995112999357s: None 2024-02-23T02:10:07.707658338Z [2024-02-23 02:10:07,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8894781f-442c-4069-9214-026835a8e0ef] received 2024-02-23T02:10:07.716308465Z [2024-02-23 02:10:07,715: INFO/ForkPoolWorker-15] [8894781f-442c-4069-9214-026835a8e0ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:10:08.069497320Z [2024-02-23 02:10:08,066: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:10:09.181390280Z [2024-02-23 02:10:09,180: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:10:09.184606420Z [2024-02-23 02:10:09,184: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:09.207922112Z [2024-02-23 02:10:09,207: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:10:09.209518481Z [2024-02-23 02:10:09,209: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:10:09.209541057Z [2024-02-23 02:10:09,209: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:10:09.209548507Z [2024-02-23 02:10:09,209: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:10:09.209593030Z [2024-02-23 02:10:09,209: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:10:09.209872423Z [2024-02-23 02:10:09,209: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:10:09.209881997Z [2024-02-23 02:10:09,209: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:10:09.312095561Z [2024-02-23 02:10:09,311: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:09.963814382Z [2024-02-23 02:10:09,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8894781f-442c-4069-9214-026835a8e0ef] succeeded in 2.254138553998928s: None 2024-02-23T02:10:10.053987619Z [2024-02-23 02:10:10,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d993ecd-773a-4b92-84cd-bf4756d047bd] received 2024-02-23T02:10:10.061200393Z [2024-02-23 02:10:10,060: INFO/ForkPoolWorker-15] [7d993ecd-773a-4b92-84cd-bf4756d047bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:10:10.346327992Z [2024-02-23 02:10:10,343: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:10:11.508348197Z [2024-02-23 02:10:11,507: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:10:11.511690510Z [2024-02-23 02:10:11,511: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:10:11.537200453Z [2024-02-23 02:10:11,537: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:10:11.539774027Z [2024-02-23 02:10:11,539: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:10:11.539819624Z [2024-02-23 02:10:11,539: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:10:11.539929158Z [2024-02-23 02:10:11,539: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:10:11.540040432Z [2024-02-23 02:10:11,539: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:10:11.540416184Z [2024-02-23 02:10:11,540: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:10:11.540447467Z [2024-02-23 02:10:11,540: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:10:11.675323816Z [2024-02-23 02:10:11,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:10:12.301147408Z [2024-02-23 02:10:12,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d993ecd-773a-4b92-84cd-bf4756d047bd] succeeded in 2.2457597390002775s: None 2024-02-23T02:11:00.902421622Z [2024-02-23 02:11:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed2796c-1ad9-4041-8bf4-d1d3a45a6bca] received 2024-02-23T02:11:00.907679803Z [2024-02-23 02:11:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b3611d1-06c7-4f1d-aa8b-2dc445ebc16b] received 2024-02-23T02:11:00.911846132Z [2024-02-23 02:11:00,911: INFO/ForkPoolWorker-15] [8ed2796c-1ad9-4041-8bf4-d1d3a45a6bca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:11:00.913441271Z [2024-02-23 02:11:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c46691d0-4746-4734-878d-108af8814034] received 2024-02-23T02:11:00.923936938Z [2024-02-23 02:11:00,922: INFO/ForkPoolWorker-16] [5b3611d1-06c7-4f1d-aa8b-2dc445ebc16b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:11:00.924937455Z [2024-02-23 02:11:00,924: INFO/ForkPoolWorker-1] [c46691d0-4746-4734-878d-108af8814034] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:11:01.263600977Z [2024-02-23 02:11:01,259: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:11:01.271861184Z [2024-02-23 02:11:01,269: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:11:01.274282272Z [2024-02-23 02:11:01,271: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:11:01.451148621Z [2024-02-23 02:11:01,450: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:11:01.455287894Z [2024-02-23 02:11:01,454: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:11:01.477392486Z [2024-02-23 02:11:01,477: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:11:01.478298134Z [2024-02-23 02:11:01,478: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:11:01.478351855Z [2024-02-23 02:11:01,478: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:11:01.478374863Z [2024-02-23 02:11:01,478: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:11:01.478594868Z [2024-02-23 02:11:01,478: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:11:01.568228158Z [2024-02-23 02:11:01,567: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:11:02.235827264Z [2024-02-23 02:11:02,235: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c46691d0-4746-4734-878d-108af8814034] succeeded in 1.3190864640000655s: None 2024-02-23T02:11:02.493988071Z [2024-02-23 02:11:02,493: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:11:02.497487541Z [2024-02-23 02:11:02,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:11:02.522932907Z [2024-02-23 02:11:02,522: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:11:02.524490099Z [2024-02-23 02:11:02,524: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:11:02.524559970Z [2024-02-23 02:11:02,524: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:11:02.524786850Z [2024-02-23 02:11:02,524: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:11:02.524843822Z [2024-02-23 02:11:02,524: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:11:02.525383545Z [2024-02-23 02:11:02,525: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:11:02.525445943Z [2024-02-23 02:11:02,525: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:11:02.548969491Z [2024-02-23 02:11:02,548: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:11:02.552389446Z [2024-02-23 02:11:02,551: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:11:02.579635033Z [2024-02-23 02:11:02,579: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:11:02.581081358Z [2024-02-23 02:11:02,580: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:11:02.581100989Z [2024-02-23 02:11:02,580: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:11:02.581282039Z [2024-02-23 02:11:02,581: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:11:02.581397453Z [2024-02-23 02:11:02,581: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:11:02.581717090Z [2024-02-23 02:11:02,581: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:11:02.581854942Z [2024-02-23 02:11:02,581: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:11:02.612634080Z [2024-02-23 02:11:02,612: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:11:02.680972779Z [2024-02-23 02:11:02,680: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:11:04.635650043Z [2024-02-23 02:11:04,635: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ed2796c-1ad9-4041-8bf4-d1d3a45a6bca] succeeded in 3.731473972000458s: None 2024-02-23T02:11:05.285616300Z [2024-02-23 02:11:05,284: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b3611d1-06c7-4f1d-aa8b-2dc445ebc16b] succeeded in 4.373485640000581s: None 2024-02-23T02:12:00.659235725Z [2024-02-23 02:12:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e25fbd39-51a6-4743-bc84-e9dded2994e3] received 2024-02-23T02:12:00.663300729Z [2024-02-23 02:12:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb248210-f8ff-4b80-80b7-bda64cd961f7] received 2024-02-23T02:12:00.666214534Z [2024-02-23 02:12:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08681ca8-8b3d-4062-81c8-3948f3d16db3] received 2024-02-23T02:12:00.668561446Z [2024-02-23 02:12:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e592cf4-1cd2-4551-869a-dfd7a7f07d59] received 2024-02-23T02:12:00.682734534Z [2024-02-23 02:12:00,682: INFO/ForkPoolWorker-15] [e25fbd39-51a6-4743-bc84-e9dded2994e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:12:00.683459492Z [2024-02-23 02:12:00,683: INFO/ForkPoolWorker-2] [8e592cf4-1cd2-4551-869a-dfd7a7f07d59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:12:00.683937489Z [2024-02-23 02:12:00,683: INFO/ForkPoolWorker-1] [08681ca8-8b3d-4062-81c8-3948f3d16db3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:12:00.687491010Z [2024-02-23 02:12:00,687: INFO/ForkPoolWorker-16] [cb248210-f8ff-4b80-80b7-bda64cd961f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:12:01.035579161Z [2024-02-23 02:12:01,028: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:12:01.054416601Z [2024-02-23 02:12:01,051: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:12:01.058540206Z [2024-02-23 02:12:01,055: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:12:01.065831736Z [2024-02-23 02:12:01,061: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:12:01.231663931Z [2024-02-23 02:12:01,229: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:12:01.238010901Z [2024-02-23 02:12:01,237: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:12:01.277337518Z [2024-02-23 02:12:01,276: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:12:01.284011007Z [2024-02-23 02:12:01,283: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:12:01.284246959Z [2024-02-23 02:12:01,283: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:12:01.284450048Z [2024-02-23 02:12:01,284: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:12:01.285850915Z [2024-02-23 02:12:01,284: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:12:01.443104086Z [2024-02-23 02:12:01,437: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:12:01.465797033Z [2024-02-23 02:12:01,465: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:12:02.127866507Z [2024-02-23 02:12:02,127: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb248210-f8ff-4b80-80b7-bda64cd961f7] succeeded in 1.4631191899989062s: None 2024-02-23T02:12:02.182733591Z [2024-02-23 02:12:02,181: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08681ca8-8b3d-4062-81c8-3948f3d16db3] succeeded in 1.5121544249996077s: None 2024-02-23T02:12:02.641512315Z [2024-02-23 02:12:02,641: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:12:02.648165570Z [2024-02-23 02:12:02,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:12:02.667675793Z [2024-02-23 02:12:02,667: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:12:02.671538752Z [2024-02-23 02:12:02,670: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:12:02.677917282Z [2024-02-23 02:12:02,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:12:02.679735657Z [2024-02-23 02:12:02,679: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:12:02.679749485Z [2024-02-23 02:12:02,679: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:12:02.679916692Z [2024-02-23 02:12:02,679: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:12:02.679938857Z [2024-02-23 02:12:02,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:12:02.680280169Z [2024-02-23 02:12:02,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:12:02.680287597Z [2024-02-23 02:12:02,680: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:12:02.693027616Z [2024-02-23 02:12:02,692: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:12:02.695827537Z [2024-02-23 02:12:02,695: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:12:02.695839491Z [2024-02-23 02:12:02,695: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:12:02.696039067Z [2024-02-23 02:12:02,695: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:12:02.696046499Z [2024-02-23 02:12:02,695: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:12:02.696406352Z [2024-02-23 02:12:02,696: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:12:02.696589298Z [2024-02-23 02:12:02,696: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:12:02.791220780Z [2024-02-23 02:12:02,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:12:02.840930552Z [2024-02-23 02:12:02,840: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:12:05.296654282Z [2024-02-23 02:12:05,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e25fbd39-51a6-4743-bc84-e9dded2994e3] succeeded in 4.626647776998652s: None 2024-02-23T02:12:06.023811778Z [2024-02-23 02:12:06,023: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e592cf4-1cd2-4551-869a-dfd7a7f07d59] succeeded in 5.352213940001093s: None 2024-02-23T02:13:00.936353309Z [2024-02-23 02:13:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a03a41b-1a3a-487a-95e0-13b6eb9cfb3a] received 2024-02-23T02:13:00.938417898Z [2024-02-23 02:13:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[968482f3-d150-48d5-8def-016e8c1cc2c8] received 2024-02-23T02:13:00.945324040Z [2024-02-23 02:13:00,945: INFO/ForkPoolWorker-15] [7a03a41b-1a3a-487a-95e0-13b6eb9cfb3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:13:00.948537938Z [2024-02-23 02:13:00,948: INFO/ForkPoolWorker-16] [968482f3-d150-48d5-8def-016e8c1cc2c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:13:00.951455334Z [2024-02-23 02:13:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e41e754-f7b0-4534-bc9d-6fd991c60f52] received 2024-02-23T02:13:00.961121517Z [2024-02-23 02:13:00,960: INFO/ForkPoolWorker-1] [5e41e754-f7b0-4534-bc9d-6fd991c60f52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:13:01.289710477Z [2024-02-23 02:13:01,286: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:13:01.319763072Z [2024-02-23 02:13:01,316: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:13:01.324997315Z [2024-02-23 02:13:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:13:01.447810309Z [2024-02-23 02:13:01,447: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:13:01.451813178Z [2024-02-23 02:13:01,451: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:13:01.480027873Z [2024-02-23 02:13:01,479: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:13:01.481147058Z [2024-02-23 02:13:01,480: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:13:01.481295382Z [2024-02-23 02:13:01,481: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:13:01.481495979Z [2024-02-23 02:13:01,481: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:13:01.481782059Z [2024-02-23 02:13:01,481: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:13:01.595643962Z [2024-02-23 02:13:01,595: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:13:02.279235349Z [2024-02-23 02:13:02,272: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e41e754-f7b0-4534-bc9d-6fd991c60f52] succeeded in 1.3186017369989713s: None 2024-02-23T02:13:02.512200592Z [2024-02-23 02:13:02,501: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:13:02.513123905Z [2024-02-23 02:13:02,504: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:13:02.525284613Z [2024-02-23 02:13:02,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:13:02.527857237Z [2024-02-23 02:13:02,527: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:13:02.527992604Z [2024-02-23 02:13:02,527: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:13:02.528273975Z [2024-02-23 02:13:02,527: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:13:02.528283046Z [2024-02-23 02:13:02,528: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:13:02.528581021Z [2024-02-23 02:13:02,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:13:02.528718016Z [2024-02-23 02:13:02,528: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:13:02.562601393Z [2024-02-23 02:13:02,562: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:13:02.566366029Z [2024-02-23 02:13:02,565: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:13:02.586130648Z [2024-02-23 02:13:02,585: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:13:02.587973737Z [2024-02-23 02:13:02,587: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:13:02.588001071Z [2024-02-23 02:13:02,587: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:13:02.588121178Z [2024-02-23 02:13:02,587: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:13:02.588239335Z [2024-02-23 02:13:02,588: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:13:02.588632989Z [2024-02-23 02:13:02,588: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:13:02.588757270Z [2024-02-23 02:13:02,588: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:13:02.603543536Z [2024-02-23 02:13:02,603: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:13:02.672649783Z [2024-02-23 02:13:02,672: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:13:05.192910398Z [2024-02-23 02:13:05,192: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[968482f3-d150-48d5-8def-016e8c1cc2c8] succeeded in 4.250205988999369s: None 2024-02-23T02:13:06.276168796Z [2024-02-23 02:13:06,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a03a41b-1a3a-487a-95e0-13b6eb9cfb3a] succeeded in 5.33813102699969s: None 2024-02-23T02:14:01.237069543Z [2024-02-23 02:14:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93e08601-6639-47be-beb8-59a2f1addc9f] received 2024-02-23T02:14:01.245277069Z [2024-02-23 02:14:01,244: INFO/ForkPoolWorker-15] [93e08601-6639-47be-beb8-59a2f1addc9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:14:01.245816648Z [2024-02-23 02:14:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11f90d59-bf04-40d5-bd27-070730dad264] received 2024-02-23T02:14:01.256339325Z [2024-02-23 02:14:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2bb6921-d019-4c0c-abaa-de06d2eb2deb] received 2024-02-23T02:14:01.261728952Z [2024-02-23 02:14:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae072a60-995b-46e9-9680-1e8f2327d201] received 2024-02-23T02:14:01.269501160Z [2024-02-23 02:14:01,269: INFO/ForkPoolWorker-16] [11f90d59-bf04-40d5-bd27-070730dad264] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:14:01.270925750Z [2024-02-23 02:14:01,270: INFO/ForkPoolWorker-2] [ae072a60-995b-46e9-9680-1e8f2327d201] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:14:01.272184931Z [2024-02-23 02:14:01,271: INFO/ForkPoolWorker-1] [a2bb6921-d019-4c0c-abaa-de06d2eb2deb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:14:01.745753920Z [2024-02-23 02:14:01,737: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:14:01.825869373Z [2024-02-23 02:14:01,823: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:14:01.857028727Z [2024-02-23 02:14:01,853: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:14:01.933129154Z [2024-02-23 02:14:01,924: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:14:02.039902557Z [2024-02-23 02:14:02,039: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:14:02.045178339Z [2024-02-23 02:14:02,044: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:14:02.052334443Z [2024-02-23 02:14:02,052: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:14:02.091935914Z [2024-02-23 02:14:02,091: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:14:02.095709178Z [2024-02-23 02:14:02,095: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:14:02.095812081Z [2024-02-23 02:14:02,095: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:14:02.095892918Z [2024-02-23 02:14:02,095: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:14:02.096129728Z [2024-02-23 02:14:02,096: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:14:02.224745585Z [2024-02-23 02:14:02,224: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:14:02.829554266Z [2024-02-23 02:14:02,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93e08601-6639-47be-beb8-59a2f1addc9f] succeeded in 1.591011417000118s: None 2024-02-23T02:14:03.098692690Z [2024-02-23 02:14:03,098: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ae072a60-995b-46e9-9680-1e8f2327d201] succeeded in 1.8344213420004962s: None 2024-02-23T02:14:03.840968233Z [2024-02-23 02:14:03,840: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:14:03.844234983Z [2024-02-23 02:14:03,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:14:03.868899545Z [2024-02-23 02:14:03,868: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:14:03.870141590Z [2024-02-23 02:14:03,869: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:14:03.870293577Z [2024-02-23 02:14:03,870: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:14:03.870454609Z [2024-02-23 02:14:03,870: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:14:03.870603113Z [2024-02-23 02:14:03,870: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:14:03.870905486Z [2024-02-23 02:14:03,870: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:14:03.871143133Z [2024-02-23 02:14:03,870: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:14:03.929635198Z [2024-02-23 02:14:03,929: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:14:03.932819905Z [2024-02-23 02:14:03,932: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:14:03.957446877Z [2024-02-23 02:14:03,957: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:14:03.958514555Z [2024-02-23 02:14:03,958: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:14:03.958528065Z [2024-02-23 02:14:03,958: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:14:03.958666548Z [2024-02-23 02:14:03,958: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:14:03.958675988Z [2024-02-23 02:14:03,958: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:14:03.958927721Z [2024-02-23 02:14:03,958: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:14:03.958937787Z [2024-02-23 02:14:03,958: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:14:03.959729922Z [2024-02-23 02:14:03,959: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:14:04.045411115Z [2024-02-23 02:14:04,045: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:14:06.468513372Z [2024-02-23 02:14:06,468: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2bb6921-d019-4c0c-abaa-de06d2eb2deb] succeeded in 5.207839099999546s: None 2024-02-23T02:14:07.527809093Z [2024-02-23 02:14:07,526: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11f90d59-bf04-40d5-bd27-070730dad264] succeeded in 6.279724267998972s: None 2024-02-23T02:15:00.344602110Z [2024-02-23 02:15:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd099539-e1bd-4597-868b-c038b10f983c] received 2024-02-23T02:15:00.346693022Z [2024-02-23 02:15:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9d1a44-b392-4d6d-b942-ebaa77fde376] received 2024-02-23T02:15:00.352411621Z [2024-02-23 02:15:00,352: INFO/ForkPoolWorker-15] [fd099539-e1bd-4597-868b-c038b10f983c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:15:00.354879969Z [2024-02-23 02:15:00,354: INFO/ForkPoolWorker-16] [5d9d1a44-b392-4d6d-b942-ebaa77fde376] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:15:00.357083073Z [2024-02-23 02:15:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef7db624-a1de-4083-95ac-31953e8feb76] received 2024-02-23T02:15:00.367955752Z [2024-02-23 02:15:00,367: INFO/ForkPoolWorker-1] [ef7db624-a1de-4083-95ac-31953e8feb76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:15:00.372922561Z [2024-02-23 02:15:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c49f1871-4ed3-49be-b2c3-c279bb3ef4ad] received 2024-02-23T02:15:00.390769289Z [2024-02-23 02:15:00,390: INFO/ForkPoolWorker-2] [c49f1871-4ed3-49be-b2c3-c279bb3ef4ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:15:00.696217210Z [2024-02-23 02:15:00,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:15:00.704978500Z [2024-02-23 02:15:00,701: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:15:00.753186179Z [2024-02-23 02:15:00,750: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:15:00.823540769Z [2024-02-23 02:15:00,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:15:00.908772185Z [2024-02-23 02:15:00,908: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:15:00.918572196Z [2024-02-23 02:15:00,917: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:00.959455359Z [2024-02-23 02:15:00,959: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:15:00.962143022Z [2024-02-23 02:15:00,961: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:15:00.962267929Z [2024-02-23 02:15:00,962: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:15:00.962387763Z [2024-02-23 02:15:00,962: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:15:00.962646146Z [2024-02-23 02:15:00,962: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:15:01.050973858Z [2024-02-23 02:15:01,050: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:01.627943655Z [2024-02-23 02:15:01,627: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c49f1871-4ed3-49be-b2c3-c279bb3ef4ad] succeeded in 1.2492240110004786s: None 2024-02-23T02:15:02.112024573Z [2024-02-23 02:15:02,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:15:02.119088645Z [2024-02-23 02:15:02,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:02.148221053Z [2024-02-23 02:15:02,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:15:02.150436898Z [2024-02-23 02:15:02,150: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:15:02.150882516Z [2024-02-23 02:15:02,150: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:15:02.151279245Z [2024-02-23 02:15:02,150: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:15:02.151606458Z [2024-02-23 02:15:02,151: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:15:02.152232015Z [2024-02-23 02:15:02,151: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:15:02.152478392Z [2024-02-23 02:15:02,152: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:15:02.218604956Z [2024-02-23 02:15:02,218: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:15:02.222142436Z [2024-02-23 02:15:02,221: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:02.243688138Z [2024-02-23 02:15:02,243: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:15:02.244962749Z [2024-02-23 02:15:02,244: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:15:02.245047879Z [2024-02-23 02:15:02,244: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:15:02.245232180Z [2024-02-23 02:15:02,245: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:15:02.245304785Z [2024-02-23 02:15:02,245: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:15:02.245545278Z [2024-02-23 02:15:02,245: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:15:02.245875582Z [2024-02-23 02:15:02,245: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:15:02.313523369Z [2024-02-23 02:15:02,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:02.323742008Z [2024-02-23 02:15:02,323: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:15:02.328264984Z [2024-02-23 02:15:02,327: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:02.331533071Z [2024-02-23 02:15:02,331: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:02.373588080Z [2024-02-23 02:15:02,373: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:15:02.377050007Z [2024-02-23 02:15:02,376: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:15:02.377909512Z [2024-02-23 02:15:02,377: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:15:02.378155324Z [2024-02-23 02:15:02,377: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:15:02.378337022Z [2024-02-23 02:15:02,378: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:15:02.378812273Z [2024-02-23 02:15:02,378: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:15:02.378996515Z [2024-02-23 02:15:02,378: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:15:02.495581348Z [2024-02-23 02:15:02,495: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:02.952912793Z [2024-02-23 02:15:02,952: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd099539-e1bd-4597-868b-c038b10f983c] succeeded in 2.605103833000612s: None 2024-02-23T02:15:03.139435751Z [2024-02-23 02:15:03,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fef64a0-a87d-467e-8731-bb3c9a4afcbf] received 2024-02-23T02:15:03.147539679Z [2024-02-23 02:15:03,147: INFO/ForkPoolWorker-15] [3fef64a0-a87d-467e-8731-bb3c9a4afcbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:15:03.456300262Z [2024-02-23 02:15:03,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:15:04.357738906Z [2024-02-23 02:15:04,356: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d9d1a44-b392-4d6d-b942-ebaa77fde376] succeeded in 4.009265687998777s: None 2024-02-23T02:15:04.595338660Z [2024-02-23 02:15:04,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:15:04.598958739Z [2024-02-23 02:15:04,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:04.627589155Z [2024-02-23 02:15:04,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:15:04.630559987Z [2024-02-23 02:15:04,630: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:15:04.635273267Z [2024-02-23 02:15:04,631: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:15:04.635304181Z [2024-02-23 02:15:04,631: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:15:04.635312087Z [2024-02-23 02:15:04,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:15:04.635317228Z [2024-02-23 02:15:04,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:15:04.635324133Z [2024-02-23 02:15:04,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:15:04.638093084Z [2024-02-23 02:15:04,636: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef7db624-a1de-4083-95ac-31953e8feb76] succeeded in 4.277962924001258s: None 2024-02-23T02:15:04.746027580Z [2024-02-23 02:15:04,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:05.450028405Z [2024-02-23 02:15:05,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3fef64a0-a87d-467e-8731-bb3c9a4afcbf] succeeded in 2.3076151959994604s: None 2024-02-23T02:15:06.522855442Z [2024-02-23 02:15:06,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[645b4ee2-f22a-4cf3-86f9-09c33cdad54d] received 2024-02-23T02:15:06.532773522Z [2024-02-23 02:15:06,532: INFO/ForkPoolWorker-15] [645b4ee2-f22a-4cf3-86f9-09c33cdad54d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:15:06.840688874Z [2024-02-23 02:15:06,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:15:07.938276412Z [2024-02-23 02:15:07,934: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:15:07.938307344Z [2024-02-23 02:15:07,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:07.974947760Z [2024-02-23 02:15:07,974: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:15:07.976320129Z [2024-02-23 02:15:07,976: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:15:07.976629820Z [2024-02-23 02:15:07,976: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:15:07.976973409Z [2024-02-23 02:15:07,976: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:15:07.977190925Z [2024-02-23 02:15:07,977: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:15:07.977704558Z [2024-02-23 02:15:07,977: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:15:07.977943064Z [2024-02-23 02:15:07,977: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:15:08.077473702Z [2024-02-23 02:15:08,077: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:08.578816636Z [2024-02-23 02:15:08,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[645b4ee2-f22a-4cf3-86f9-09c33cdad54d] succeeded in 2.054268370999125s: None 2024-02-23T02:15:08.822866232Z [2024-02-23 02:15:08,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11d4e21d-8d5f-425f-a27b-004714a0c1da] received 2024-02-23T02:15:08.829908496Z [2024-02-23 02:15:08,829: INFO/ForkPoolWorker-15] [11d4e21d-8d5f-425f-a27b-004714a0c1da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:15:09.099900753Z [2024-02-23 02:15:09,097: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:15:10.193157659Z [2024-02-23 02:15:10,192: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:15:10.196243223Z [2024-02-23 02:15:10,195: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:15:10.214224746Z [2024-02-23 02:15:10,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:15:10.215769779Z [2024-02-23 02:15:10,215: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:15:10.215808070Z [2024-02-23 02:15:10,215: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:15:10.215973896Z [2024-02-23 02:15:10,215: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:15:10.216067083Z [2024-02-23 02:15:10,215: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:15:10.216361198Z [2024-02-23 02:15:10,216: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:15:10.216464642Z [2024-02-23 02:15:10,216: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:15:10.309742178Z [2024-02-23 02:15:10,309: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:15:10.786055344Z [2024-02-23 02:15:10,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11d4e21d-8d5f-425f-a27b-004714a0c1da] succeeded in 1.9614078590002464s: None 2024-02-23T02:16:01.018168807Z [2024-02-23 02:16:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b6a4fd3-cc5d-4eec-8c2d-d6fa3224f5ea] received 2024-02-23T02:16:01.020814130Z [2024-02-23 02:16:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf3a0a66-6bec-4241-a438-ae1e8a9a8347] received 2024-02-23T02:16:01.027457904Z [2024-02-23 02:16:01,027: INFO/ForkPoolWorker-15] [6b6a4fd3-cc5d-4eec-8c2d-d6fa3224f5ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:16:01.031033012Z [2024-02-23 02:16:01,029: INFO/ForkPoolWorker-16] [bf3a0a66-6bec-4241-a438-ae1e8a9a8347] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:16:01.034634835Z [2024-02-23 02:16:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfd7bab7-7ce3-44cd-9da9-d47eb591859b] received 2024-02-23T02:16:01.041442435Z [2024-02-23 02:16:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[795ab235-22f7-4e3f-88a4-e8d0398464f8] received 2024-02-23T02:16:01.043870219Z [2024-02-23 02:16:01,043: INFO/ForkPoolWorker-1] [dfd7bab7-7ce3-44cd-9da9-d47eb591859b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:16:01.054351602Z [2024-02-23 02:16:01,054: INFO/ForkPoolWorker-2] [795ab235-22f7-4e3f-88a4-e8d0398464f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:16:01.405249355Z [2024-02-23 02:16:01,402: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:16:01.438416123Z [2024-02-23 02:16:01,435: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:16:01.443461284Z [2024-02-23 02:16:01,440: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:16:01.472341326Z [2024-02-23 02:16:01,469: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:16:01.564948909Z [2024-02-23 02:16:01,564: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:16:01.568872854Z [2024-02-23 02:16:01,568: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:16:01.608072125Z [2024-02-23 02:16:01,607: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:16:01.609620271Z [2024-02-23 02:16:01,609: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:16:01.609930057Z [2024-02-23 02:16:01,609: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:16:01.610110553Z [2024-02-23 02:16:01,609: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:16:01.610576910Z [2024-02-23 02:16:01,610: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:16:01.697854132Z [2024-02-23 02:16:01,697: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:16:01.717389128Z [2024-02-23 02:16:01,717: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:16:02.287766696Z [2024-02-23 02:16:02,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dfd7bab7-7ce3-44cd-9da9-d47eb591859b] succeeded in 1.248941042998922s: None 2024-02-23T02:16:02.358989676Z [2024-02-23 02:16:02,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf3a0a66-6bec-4241-a438-ae1e8a9a8347] succeeded in 1.3366668060007214s: None 2024-02-23T02:16:02.763273633Z [2024-02-23 02:16:02,762: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:16:02.766761757Z [2024-02-23 02:16:02,766: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:16:02.774109982Z [2024-02-23 02:16:02,773: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:16:02.777272767Z [2024-02-23 02:16:02,776: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:16:02.788098267Z [2024-02-23 02:16:02,787: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:16:02.789617599Z [2024-02-23 02:16:02,789: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:16:02.789800854Z [2024-02-23 02:16:02,789: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:16:02.790042641Z [2024-02-23 02:16:02,789: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:16:02.790199673Z [2024-02-23 02:16:02,790: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:16:02.790910880Z [2024-02-23 02:16:02,790: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:16:02.791167980Z [2024-02-23 02:16:02,791: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:16:02.803911126Z [2024-02-23 02:16:02,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:16:02.805393240Z [2024-02-23 02:16:02,805: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:16:02.805448456Z [2024-02-23 02:16:02,805: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:16:02.805657625Z [2024-02-23 02:16:02,805: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:16:02.805765784Z [2024-02-23 02:16:02,805: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:16:02.806050055Z [2024-02-23 02:16:02,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:16:02.806207820Z [2024-02-23 02:16:02,805: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:16:02.882362234Z [2024-02-23 02:16:02,882: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:16:02.882388916Z [2024-02-23 02:16:02,882: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:16:04.532432277Z [2024-02-23 02:16:04,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b6a4fd3-cc5d-4eec-8c2d-d6fa3224f5ea] succeeded in 3.510491847000594s: None 2024-02-23T02:16:05.064023597Z [2024-02-23 02:16:05,063: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[795ab235-22f7-4e3f-88a4-e8d0398464f8] succeeded in 4.017752822999682s: None 2024-02-23T02:17:00.781377873Z [2024-02-23 02:17:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[849bdc1c-3ad0-498b-b565-55f60891851e] received 2024-02-23T02:17:00.791681403Z [2024-02-23 02:17:00,791: INFO/ForkPoolWorker-15] [849bdc1c-3ad0-498b-b565-55f60891851e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:17:00.792034911Z [2024-02-23 02:17:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8214fa4-522b-40f1-a29e-b53323bd05ec] received 2024-02-23T02:17:00.802184334Z [2024-02-23 02:17:00,801: INFO/ForkPoolWorker-16] [c8214fa4-522b-40f1-a29e-b53323bd05ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:17:00.807365515Z [2024-02-23 02:17:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee114af8-c331-492c-bfa0-033e22b235c2] received 2024-02-23T02:17:00.815425458Z [2024-02-23 02:17:00,815: INFO/ForkPoolWorker-1] [ee114af8-c331-492c-bfa0-033e22b235c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:17:01.103197440Z [2024-02-23 02:17:01,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:17:01.103259201Z [2024-02-23 02:17:01,100: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:17:01.108836870Z [2024-02-23 02:17:01,105: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:17:01.266947824Z [2024-02-23 02:17:01,266: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:17:01.270891898Z [2024-02-23 02:17:01,270: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:17:01.297524387Z [2024-02-23 02:17:01,297: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:17:01.299650213Z [2024-02-23 02:17:01,299: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:17:01.299843753Z [2024-02-23 02:17:01,299: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:17:01.299965757Z [2024-02-23 02:17:01,299: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:17:01.300285521Z [2024-02-23 02:17:01,300: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:17:01.424418062Z [2024-02-23 02:17:01,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:17:02.038120426Z [2024-02-23 02:17:02,037: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ee114af8-c331-492c-bfa0-033e22b235c2] succeeded in 1.2288956539996434s: None 2024-02-23T02:17:02.206347476Z [2024-02-23 02:17:02,206: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:17:02.209611599Z [2024-02-23 02:17:02,209: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:17:02.232694887Z [2024-02-23 02:17:02,232: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:17:02.234075992Z [2024-02-23 02:17:02,233: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:17:02.234178856Z [2024-02-23 02:17:02,234: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:17:02.234373262Z [2024-02-23 02:17:02,234: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:17:02.234489228Z [2024-02-23 02:17:02,234: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:17:02.234782786Z [2024-02-23 02:17:02,234: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:17:02.234938413Z [2024-02-23 02:17:02,234: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:17:02.342009369Z [2024-02-23 02:17:02,341: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:17:02.345808520Z [2024-02-23 02:17:02,345: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:17:02.346403456Z [2024-02-23 02:17:02,346: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:17:02.377599411Z [2024-02-23 02:17:02,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:17:02.381891607Z [2024-02-23 02:17:02,381: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:17:02.382005157Z [2024-02-23 02:17:02,381: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:17:02.383284044Z [2024-02-23 02:17:02,381: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:17:02.383536595Z [2024-02-23 02:17:02,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:17:02.384243210Z [2024-02-23 02:17:02,383: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:17:02.384503682Z [2024-02-23 02:17:02,384: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:17:02.494818673Z [2024-02-23 02:17:02,494: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:17:03.956452866Z [2024-02-23 02:17:03,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8214fa4-522b-40f1-a29e-b53323bd05ec] succeeded in 3.160454734999803s: None 2024-02-23T02:17:04.260688975Z [2024-02-23 02:17:04,260: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[849bdc1c-3ad0-498b-b565-55f60891851e] succeeded in 3.475036870000622s: None 2024-02-23T02:18:01.113120606Z [2024-02-23 02:18:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf1f837e-c3af-4f90-bc3d-d8722e70b22a] received 2024-02-23T02:18:01.118372009Z [2024-02-23 02:18:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb500177-caaf-4040-a1d8-778aca7c049f] received 2024-02-23T02:18:01.121010959Z [2024-02-23 02:18:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59df953e-ca89-4cb7-a3de-05335c519507] received 2024-02-23T02:18:01.122564097Z [2024-02-23 02:18:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc8e6c8b-142c-4559-bfae-18d3008e0e68] received 2024-02-23T02:18:01.128965445Z [2024-02-23 02:18:01,128: INFO/ForkPoolWorker-2] [fc8e6c8b-142c-4559-bfae-18d3008e0e68] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:18:01.132683906Z [2024-02-23 02:18:01,132: INFO/ForkPoolWorker-15] [cf1f837e-c3af-4f90-bc3d-d8722e70b22a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:18:01.133275641Z [2024-02-23 02:18:01,132: INFO/ForkPoolWorker-1] [59df953e-ca89-4cb7-a3de-05335c519507] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:18:01.133545536Z [2024-02-23 02:18:01,133: INFO/ForkPoolWorker-16] [cb500177-caaf-4040-a1d8-778aca7c049f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:18:01.431962036Z [2024-02-23 02:18:01,429: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:18:01.450443564Z [2024-02-23 02:18:01,446: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:18:01.462896843Z [2024-02-23 02:18:01,456: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:18:01.510589496Z [2024-02-23 02:18:01,504: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:18:01.598600821Z [2024-02-23 02:18:01,598: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:18:01.605184429Z [2024-02-23 02:18:01,604: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:18:01.648190509Z [2024-02-23 02:18:01,647: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:18:01.651179188Z [2024-02-23 02:18:01,650: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:18:01.651950038Z [2024-02-23 02:18:01,651: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:18:01.652229929Z [2024-02-23 02:18:01,652: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:18:01.652721520Z [2024-02-23 02:18:01,652: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:18:01.798675126Z [2024-02-23 02:18:01,798: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:18:01.891176791Z [2024-02-23 02:18:01,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:18:02.399451839Z [2024-02-23 02:18:02,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf1f837e-c3af-4f90-bc3d-d8722e70b22a] succeeded in 1.2795380529987597s: None 2024-02-23T02:18:02.452038784Z [2024-02-23 02:18:02,451: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc8e6c8b-142c-4559-bfae-18d3008e0e68] succeeded in 1.3282155849992705s: None 2024-02-23T02:18:02.730380804Z [2024-02-23 02:18:02,730: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:18:02.733818061Z [2024-02-23 02:18:02,733: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:18:02.755744972Z [2024-02-23 02:18:02,755: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:18:02.757201586Z [2024-02-23 02:18:02,756: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:18:02.757231113Z [2024-02-23 02:18:02,757: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:18:02.757328004Z [2024-02-23 02:18:02,757: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:18:02.757363476Z [2024-02-23 02:18:02,757: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:18:02.757691239Z [2024-02-23 02:18:02,757: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:18:02.757747043Z [2024-02-23 02:18:02,757: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:18:02.812383783Z [2024-02-23 02:18:02,812: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:18:02.815757712Z [2024-02-23 02:18:02,815: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:18:02.837451333Z [2024-02-23 02:18:02,837: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:18:02.838897759Z [2024-02-23 02:18:02,838: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:18:02.838920530Z [2024-02-23 02:18:02,838: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:18:02.839053193Z [2024-02-23 02:18:02,838: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:18:02.839088721Z [2024-02-23 02:18:02,838: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:18:02.841045698Z [2024-02-23 02:18:02,840: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:18:02.841072169Z [2024-02-23 02:18:02,840: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:18:02.857509164Z [2024-02-23 02:18:02,857: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:18:02.964480265Z [2024-02-23 02:18:02,964: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:18:06.023243956Z [2024-02-23 02:18:06,022: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59df953e-ca89-4cb7-a3de-05335c519507] succeeded in 4.899863878999895s: None 2024-02-23T02:18:07.337027981Z [2024-02-23 02:18:07,336: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb500177-caaf-4040-a1d8-778aca7c049f] succeeded in 6.2161419019994355s: None 2024-02-23T02:19:00.470964174Z [2024-02-23 02:19:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[510acf6d-6c98-4043-b9fd-7b6f69508123] received 2024-02-23T02:19:00.487040132Z [2024-02-23 02:19:00,486: INFO/ForkPoolWorker-15] [510acf6d-6c98-4043-b9fd-7b6f69508123] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:19:00.488074461Z [2024-02-23 02:19:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c39ebf3e-3162-45a4-b7dc-b1eebd9f561b] received 2024-02-23T02:19:00.497803240Z [2024-02-23 02:19:00,497: INFO/ForkPoolWorker-16] [c39ebf3e-3162-45a4-b7dc-b1eebd9f561b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:19:00.505849288Z [2024-02-23 02:19:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7660beac-c032-48ff-baf0-3095130f8ad6] received 2024-02-23T02:19:00.513025491Z [2024-02-23 02:19:00,512: INFO/ForkPoolWorker-1] [7660beac-c032-48ff-baf0-3095130f8ad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:19:00.788704506Z [2024-02-23 02:19:00,785: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:19:00.815201372Z [2024-02-23 02:19:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:19:00.840862940Z [2024-02-23 02:19:00,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:19:00.974553490Z [2024-02-23 02:19:00,974: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:19:00.978643217Z [2024-02-23 02:19:00,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:19:01.005861225Z [2024-02-23 02:19:01,005: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:19:01.007229406Z [2024-02-23 02:19:01,007: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:19:01.007336980Z [2024-02-23 02:19:01,007: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:19:01.007445820Z [2024-02-23 02:19:01,007: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:19:01.007672362Z [2024-02-23 02:19:01,007: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:19:01.109220690Z [2024-02-23 02:19:01,108: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:19:01.730039012Z [2024-02-23 02:19:01,729: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7660beac-c032-48ff-baf0-3095130f8ad6] succeeded in 1.2219247590001032s: None 2024-02-23T02:19:01.961205870Z [2024-02-23 02:19:01,960: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:19:01.965125252Z [2024-02-23 02:19:01,964: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:19:01.994278835Z [2024-02-23 02:19:01,994: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:19:01.995814313Z [2024-02-23 02:19:01,995: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:19:01.995988472Z [2024-02-23 02:19:01,995: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:19:01.996208244Z [2024-02-23 02:19:01,995: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:19:01.996387327Z [2024-02-23 02:19:01,996: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:19:01.996882677Z [2024-02-23 02:19:01,996: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:19:01.997346751Z [2024-02-23 02:19:01,997: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:19:02.013311122Z [2024-02-23 02:19:02,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:19:02.016589114Z [2024-02-23 02:19:02,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:19:02.046476444Z [2024-02-23 02:19:02,046: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:19:02.049056318Z [2024-02-23 02:19:02,048: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:19:02.049105077Z [2024-02-23 02:19:02,048: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:19:02.050433693Z [2024-02-23 02:19:02,049: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:19:02.050479147Z [2024-02-23 02:19:02,050: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:19:02.050982103Z [2024-02-23 02:19:02,050: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:19:02.051134953Z [2024-02-23 02:19:02,050: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:19:02.111920902Z [2024-02-23 02:19:02,111: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:19:02.140228205Z [2024-02-23 02:19:02,139: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:19:03.674718952Z [2024-02-23 02:19:03,673: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c39ebf3e-3162-45a4-b7dc-b1eebd9f561b] succeeded in 3.1838510939996922s: None 2024-02-23T02:19:04.010236928Z [2024-02-23 02:19:04,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[510acf6d-6c98-4043-b9fd-7b6f69508123] succeeded in 3.5312811359999614s: None 2024-02-23T02:20:01.073383727Z [2024-02-23 02:20:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f313776-2fd6-48af-8af5-63396d055df1] received 2024-02-23T02:20:01.076098405Z [2024-02-23 02:20:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efafb437-0229-4072-856d-7dcd0d4dabb7] received 2024-02-23T02:20:01.080148570Z [2024-02-23 02:20:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7082f185-582f-47b0-bb88-92ae27c046dd] received 2024-02-23T02:20:01.082373770Z [2024-02-23 02:20:01,082: INFO/ForkPoolWorker-15] [9f313776-2fd6-48af-8af5-63396d055df1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:20:01.085772774Z [2024-02-23 02:20:01,085: INFO/ForkPoolWorker-16] [efafb437-0229-4072-856d-7dcd0d4dabb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:20:01.091838549Z [2024-02-23 02:20:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6394fa7-795b-4462-a6b3-c23b52c880ad] received 2024-02-23T02:20:01.093783294Z [2024-02-23 02:20:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e757be6f-b264-4195-96d0-2c3c7f0e18b2] received 2024-02-23T02:20:01.107838869Z [2024-02-23 02:20:01,107: INFO/ForkPoolWorker-2] [a6394fa7-795b-4462-a6b3-c23b52c880ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:20:01.108487225Z [2024-02-23 02:20:01,108: INFO/ForkPoolWorker-3] [e757be6f-b264-4195-96d0-2c3c7f0e18b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:20:01.108581134Z [2024-02-23 02:20:01,108: INFO/ForkPoolWorker-1] [7082f185-582f-47b0-bb88-92ae27c046dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:20:01.486053422Z [2024-02-23 02:20:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:20:01.547205160Z [2024-02-23 02:20:01,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:20:01.867368882Z [2024-02-23 02:20:01,867: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:01.905868328Z [2024-02-23 02:20:01,902: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:20:02.004328245Z [2024-02-23 02:20:01,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:20:02.055406091Z [2024-02-23 02:20:02,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:20:02.274527774Z [2024-02-23 02:20:02,274: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T02:20:02.284790406Z [2024-02-23 02:20:02,284: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:02.339908493Z [2024-02-23 02:20:02,339: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:20:02.345664000Z [2024-02-23 02:20:02,345: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:20:02.346797300Z [2024-02-23 02:20:02,345: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:20:02.346843736Z [2024-02-23 02:20:02,346: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T02:20:02.347070991Z [2024-02-23 02:20:02,346: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:20:02.458030789Z [2024-02-23 02:20:02,457: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:02.596633247Z [2024-02-23 02:20:02,596: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a6394fa7-795b-4462-a6b3-c23b52c880ad] succeeded in 1.5019708620002348s: None 2024-02-23T02:20:03.069447056Z [2024-02-23 02:20:03,068: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e757be6f-b264-4195-96d0-2c3c7f0e18b2] succeeded in 1.973619348000284s: None 2024-02-23T02:20:03.224783149Z [2024-02-23 02:20:03,224: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:20:03.228314735Z [2024-02-23 02:20:03,227: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:03.257193397Z [2024-02-23 02:20:03,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:20:03.260758091Z [2024-02-23 02:20:03,260: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:20:03.261185681Z [2024-02-23 02:20:03,260: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:20:03.261784908Z [2024-02-23 02:20:03,261: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:20:03.262211605Z [2024-02-23 02:20:03,261: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:20:03.262987945Z [2024-02-23 02:20:03,262: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:20:03.263564932Z [2024-02-23 02:20:03,263: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:20:03.362263656Z [2024-02-23 02:20:03,361: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:03.599946546Z [2024-02-23 02:20:03,599: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:20:03.603789305Z [2024-02-23 02:20:03,603: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:03.664021723Z [2024-02-23 02:20:03,663: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:20:03.671238112Z [2024-02-23 02:20:03,670: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:20:03.671394783Z [2024-02-23 02:20:03,671: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:20:03.671585504Z [2024-02-23 02:20:03,671: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:20:03.671716195Z [2024-02-23 02:20:03,671: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:20:03.672047528Z [2024-02-23 02:20:03,671: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:20:03.675074510Z [2024-02-23 02:20:03,672: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:20:03.695607819Z [2024-02-23 02:20:03,695: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:20:03.699038036Z [2024-02-23 02:20:03,698: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:03.756974743Z [2024-02-23 02:20:03,756: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:20:03.759444952Z [2024-02-23 02:20:03,759: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:20:03.761478373Z [2024-02-23 02:20:03,759: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:20:03.761644372Z [2024-02-23 02:20:03,761: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:20:03.761718679Z [2024-02-23 02:20:03,761: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:20:03.762053551Z [2024-02-23 02:20:03,761: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:20:03.762117914Z [2024-02-23 02:20:03,762: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:20:03.840638491Z [2024-02-23 02:20:03,840: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:03.891096837Z [2024-02-23 02:20:03,890: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:04.552528542Z [2024-02-23 02:20:04,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efafb437-0229-4072-856d-7dcd0d4dabb7] succeeded in 3.4724544100008643s: None 2024-02-23T02:20:04.896457936Z [2024-02-23 02:20:04,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f90ac828-70ff-40d3-849a-85523e357905] received 2024-02-23T02:20:04.904314226Z [2024-02-23 02:20:04,903: INFO/ForkPoolWorker-16] [f90ac828-70ff-40d3-849a-85523e357905] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:20:05.222900440Z [2024-02-23 02:20:05,219: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:20:05.457277423Z [2024-02-23 02:20:05,456: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7082f185-582f-47b0-bb88-92ae27c046dd] succeeded in 4.364152025998919s: None 2024-02-23T02:20:05.476536385Z [2024-02-23 02:20:05,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f313776-2fd6-48af-8af5-63396d055df1] succeeded in 4.399206112000684s: None 2024-02-23T02:20:06.436227939Z [2024-02-23 02:20:06,435: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:20:06.439490305Z [2024-02-23 02:20:06,439: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:06.456204985Z [2024-02-23 02:20:06,455: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:20:06.457364812Z [2024-02-23 02:20:06,457: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:20:06.457437489Z [2024-02-23 02:20:06,457: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:20:06.457612371Z [2024-02-23 02:20:06,457: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:20:06.457648484Z [2024-02-23 02:20:06,457: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:20:06.457822018Z [2024-02-23 02:20:06,457: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:20:06.457832961Z [2024-02-23 02:20:06,457: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:20:06.541616661Z [2024-02-23 02:20:06,541: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:07.152232286Z [2024-02-23 02:20:07,151: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f90ac828-70ff-40d3-849a-85523e357905] succeeded in 2.253730476000783s: None 2024-02-23T02:20:07.371701739Z [2024-02-23 02:20:07,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc14d796-2814-4e9a-9466-6721910f8e6f] received 2024-02-23T02:20:07.381588029Z [2024-02-23 02:20:07,381: INFO/ForkPoolWorker-15] [dc14d796-2814-4e9a-9466-6721910f8e6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:20:07.670008297Z [2024-02-23 02:20:07,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:20:08.864258217Z [2024-02-23 02:20:08,863: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:20:08.867541560Z [2024-02-23 02:20:08,867: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:08.885583661Z [2024-02-23 02:20:08,885: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:20:08.886817538Z [2024-02-23 02:20:08,886: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:20:08.886908802Z [2024-02-23 02:20:08,886: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:20:08.887051334Z [2024-02-23 02:20:08,886: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:20:08.887111182Z [2024-02-23 02:20:08,887: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:20:08.887426380Z [2024-02-23 02:20:08,887: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:20:08.887517712Z [2024-02-23 02:20:08,887: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:20:08.962995035Z [2024-02-23 02:20:08,962: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:09.575607454Z [2024-02-23 02:20:09,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc14d796-2814-4e9a-9466-6721910f8e6f] succeeded in 2.2011945769991144s: None 2024-02-23T02:20:09.969443482Z [2024-02-23 02:20:09,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[694cd9da-23ff-42f3-b35a-d3df9205f027] received 2024-02-23T02:20:09.983405334Z [2024-02-23 02:20:09,983: INFO/ForkPoolWorker-15] [694cd9da-23ff-42f3-b35a-d3df9205f027] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:20:10.290548705Z [2024-02-23 02:20:10,287: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:20:11.414921729Z [2024-02-23 02:20:11,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:20:11.418110670Z [2024-02-23 02:20:11,417: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:20:11.439102161Z [2024-02-23 02:20:11,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:20:11.440374550Z [2024-02-23 02:20:11,440: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:20:11.440424415Z [2024-02-23 02:20:11,440: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:20:11.440607005Z [2024-02-23 02:20:11,440: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:20:11.440727257Z [2024-02-23 02:20:11,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:20:11.441078159Z [2024-02-23 02:20:11,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:20:11.441231796Z [2024-02-23 02:20:11,441: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:20:11.541828596Z [2024-02-23 02:20:11,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:20:12.126102824Z [2024-02-23 02:20:12,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[694cd9da-23ff-42f3-b35a-d3df9205f027] succeeded in 2.152421755999967s: None 2024-02-23T02:21:00.944143971Z [2024-02-23 02:21:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c6bf06e-5302-45cb-9298-e65c97e648a8] received 2024-02-23T02:21:00.951521266Z [2024-02-23 02:21:00,951: INFO/ForkPoolWorker-15] [9c6bf06e-5302-45cb-9298-e65c97e648a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:21:00.952268777Z [2024-02-23 02:21:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90b33332-0cef-4950-9ccc-8e912a6c3a4e] received 2024-02-23T02:21:00.961675661Z [2024-02-23 02:21:00,961: INFO/ForkPoolWorker-16] [90b33332-0cef-4950-9ccc-8e912a6c3a4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:21:00.961978323Z [2024-02-23 02:21:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[057e5011-e44f-4826-b9da-73b4db63a0f3] received 2024-02-23T02:21:00.969257988Z [2024-02-23 02:21:00,968: INFO/ForkPoolWorker-1] [057e5011-e44f-4826-b9da-73b4db63a0f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:21:01.279780367Z [2024-02-23 02:21:01,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:21:01.325375105Z [2024-02-23 02:21:01,322: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:21:01.464377838Z [2024-02-23 02:21:01,460: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:21:01.498588759Z [2024-02-23 02:21:01,498: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:21:01.504007711Z [2024-02-23 02:21:01,503: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:21:01.531667691Z [2024-02-23 02:21:01,531: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:21:01.532999277Z [2024-02-23 02:21:01,532: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:21:01.533130627Z [2024-02-23 02:21:01,532: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:21:01.533238547Z [2024-02-23 02:21:01,533: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:21:01.533526946Z [2024-02-23 02:21:01,533: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:21:01.653452930Z [2024-02-23 02:21:01,653: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:21:02.319646870Z [2024-02-23 02:21:02,319: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90b33332-0cef-4950-9ccc-8e912a6c3a4e] succeeded in 1.3656469359993935s: None 2024-02-23T02:21:02.434604266Z [2024-02-23 02:21:02,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:21:02.438058061Z [2024-02-23 02:21:02,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:21:02.462653309Z [2024-02-23 02:21:02,462: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:21:02.464463248Z [2024-02-23 02:21:02,464: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:21:02.464733591Z [2024-02-23 02:21:02,464: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:21:02.465026221Z [2024-02-23 02:21:02,464: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:21:02.465203823Z [2024-02-23 02:21:02,464: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:21:02.465729010Z [2024-02-23 02:21:02,465: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:21:02.465900873Z [2024-02-23 02:21:02,465: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:21:02.566611559Z [2024-02-23 02:21:02,566: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:21:02.680006437Z [2024-02-23 02:21:02,679: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:21:02.683365768Z [2024-02-23 02:21:02,682: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:21:02.706102570Z [2024-02-23 02:21:02,705: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:21:02.707574515Z [2024-02-23 02:21:02,707: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:21:02.707595972Z [2024-02-23 02:21:02,707: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:21:02.707738280Z [2024-02-23 02:21:02,707: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:21:02.707824521Z [2024-02-23 02:21:02,707: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:21:02.708117257Z [2024-02-23 02:21:02,707: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:21:02.708179355Z [2024-02-23 02:21:02,708: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:21:02.843614157Z [2024-02-23 02:21:02,843: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:21:04.859188714Z [2024-02-23 02:21:04,858: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[057e5011-e44f-4826-b9da-73b4db63a0f3] succeeded in 3.8956604930008325s: None 2024-02-23T02:21:05.271477545Z [2024-02-23 02:21:05,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c6bf06e-5302-45cb-9298-e65c97e648a8] succeeded in 4.324971488998926s: None 2024-02-23T02:22:00.956568715Z [2024-02-23 02:22:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[717f8a7c-087e-4e26-ba15-363bc5bc20a6] received 2024-02-23T02:22:00.961527346Z [2024-02-23 02:22:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac91d9b5-a78f-47b7-9cd3-2f98eba6d176] received 2024-02-23T02:22:00.966264509Z [2024-02-23 02:22:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[481eb1ca-7770-42e7-9b70-fa232d247e55] received 2024-02-23T02:22:00.971295865Z [2024-02-23 02:22:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58a4dd22-9958-4ad0-bcda-0cdfcd11f412] received 2024-02-23T02:22:00.971324674Z [2024-02-23 02:22:00,970: INFO/ForkPoolWorker-15] [717f8a7c-087e-4e26-ba15-363bc5bc20a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:22:00.982321269Z [2024-02-23 02:22:00,981: INFO/ForkPoolWorker-16] [ac91d9b5-a78f-47b7-9cd3-2f98eba6d176] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:22:00.986158726Z [2024-02-23 02:22:00,985: INFO/ForkPoolWorker-1] [481eb1ca-7770-42e7-9b70-fa232d247e55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:22:00.987017976Z [2024-02-23 02:22:00,986: INFO/ForkPoolWorker-2] [58a4dd22-9958-4ad0-bcda-0cdfcd11f412] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:22:01.323199550Z [2024-02-23 02:22:01,320: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:22:01.328625791Z [2024-02-23 02:22:01,325: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:22:01.359137798Z [2024-02-23 02:22:01,355: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:22:01.471674909Z [2024-02-23 02:22:01,468: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:22:01.501691003Z [2024-02-23 02:22:01,501: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:22:01.506778249Z [2024-02-23 02:22:01,506: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:22:01.537572270Z [2024-02-23 02:22:01,537: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:22:01.541761834Z [2024-02-23 02:22:01,541: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:22:01.542456971Z [2024-02-23 02:22:01,541: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:22:01.543070998Z [2024-02-23 02:22:01,542: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:22:01.543491866Z [2024-02-23 02:22:01,543: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:22:01.684084545Z [2024-02-23 02:22:01,683: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:22:01.718502326Z [2024-02-23 02:22:01,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:22:02.275779745Z [2024-02-23 02:22:02,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[717f8a7c-087e-4e26-ba15-363bc5bc20a6] succeeded in 1.3132398950001516s: None 2024-02-23T02:22:02.294817176Z [2024-02-23 02:22:02,294: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[58a4dd22-9958-4ad0-bcda-0cdfcd11f412] succeeded in 1.320798618999106s: None 2024-02-23T02:22:02.672248280Z [2024-02-23 02:22:02,671: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:22:02.675743406Z [2024-02-23 02:22:02,675: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:22:02.699475072Z [2024-02-23 02:22:02,699: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:22:02.701104489Z [2024-02-23 02:22:02,700: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:22:02.701238010Z [2024-02-23 02:22:02,701: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:22:02.701517549Z [2024-02-23 02:22:02,701: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:22:02.701593033Z [2024-02-23 02:22:02,701: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:22:02.701941028Z [2024-02-23 02:22:02,701: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:22:02.701969891Z [2024-02-23 02:22:02,701: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:22:02.763175762Z [2024-02-23 02:22:02,762: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:22:02.766682465Z [2024-02-23 02:22:02,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:22:02.784812043Z [2024-02-23 02:22:02,784: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:22:02.793054301Z [2024-02-23 02:22:02,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:22:02.795013941Z [2024-02-23 02:22:02,794: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:22:02.795111747Z [2024-02-23 02:22:02,794: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:22:02.795387526Z [2024-02-23 02:22:02,795: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:22:02.795509849Z [2024-02-23 02:22:02,795: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:22:02.795841946Z [2024-02-23 02:22:02,795: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:22:02.796043213Z [2024-02-23 02:22:02,795: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:22:02.896874346Z [2024-02-23 02:22:02,896: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:22:05.641884964Z [2024-02-23 02:22:05,641: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[481eb1ca-7770-42e7-9b70-fa232d247e55] succeeded in 4.672249150000425s: None 2024-02-23T02:22:05.945812829Z [2024-02-23 02:22:05,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac91d9b5-a78f-47b7-9cd3-2f98eba6d176] succeeded in 4.981569657000364s: None 2024-02-23T02:23:00.515698117Z [2024-02-23 02:23:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0927830-3c3c-4315-a5cb-14684154a133] received 2024-02-23T02:23:00.518971664Z [2024-02-23 02:23:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a11736f-b1e3-44f0-a051-b30753a9d88c] received 2024-02-23T02:23:00.526993630Z [2024-02-23 02:23:00,526: INFO/ForkPoolWorker-16] [8a11736f-b1e3-44f0-a051-b30753a9d88c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:23:00.527011630Z [2024-02-23 02:23:00,526: INFO/ForkPoolWorker-15] [f0927830-3c3c-4315-a5cb-14684154a133] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:23:00.531533803Z [2024-02-23 02:23:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a7ac438-7746-40de-868e-9cc830c5315b] received 2024-02-23T02:23:00.544778328Z [2024-02-23 02:23:00,544: INFO/ForkPoolWorker-1] [8a7ac438-7746-40de-868e-9cc830c5315b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:23:00.844103884Z [2024-02-23 02:23:00,841: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:23:00.873141424Z [2024-02-23 02:23:00,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:23:00.882400422Z [2024-02-23 02:23:00,878: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:23:01.068810216Z [2024-02-23 02:23:01,068: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:23:01.072729793Z [2024-02-23 02:23:01,072: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:23:01.128011641Z [2024-02-23 02:23:01,127: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:23:01.131767763Z [2024-02-23 02:23:01,131: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:23:01.131934904Z [2024-02-23 02:23:01,131: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:23:01.132034552Z [2024-02-23 02:23:01,131: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:23:01.132339183Z [2024-02-23 02:23:01,132: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:23:01.268770389Z [2024-02-23 02:23:01,268: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:23:01.831319644Z [2024-02-23 02:23:01,830: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a7ac438-7746-40de-868e-9cc830c5315b] succeeded in 1.2975842269988789s: None 2024-02-23T02:23:02.114994728Z [2024-02-23 02:23:02,113: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:23:02.121258163Z [2024-02-23 02:23:02,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:23:02.161718116Z [2024-02-23 02:23:02,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:23:02.163268133Z [2024-02-23 02:23:02,163: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:23:02.164121198Z [2024-02-23 02:23:02,163: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:23:02.164607446Z [2024-02-23 02:23:02,164: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:23:02.165141302Z [2024-02-23 02:23:02,164: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:23:02.165728610Z [2024-02-23 02:23:02,165: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:23:02.167394042Z [2024-02-23 02:23:02,167: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:23:02.254525236Z [2024-02-23 02:23:02,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:23:02.335740085Z [2024-02-23 02:23:02,335: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:23:02.340420415Z [2024-02-23 02:23:02,339: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:23:02.362665273Z [2024-02-23 02:23:02,362: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:23:02.364619413Z [2024-02-23 02:23:02,364: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:23:02.364728474Z [2024-02-23 02:23:02,364: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:23:02.364749279Z [2024-02-23 02:23:02,364: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:23:02.364782615Z [2024-02-23 02:23:02,364: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:23:02.364958968Z [2024-02-23 02:23:02,364: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:23:02.365074262Z [2024-02-23 02:23:02,364: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:23:02.462374370Z [2024-02-23 02:23:02,460: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:23:04.241224359Z [2024-02-23 02:23:04,240: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0927830-3c3c-4315-a5cb-14684154a133] succeeded in 3.7216918249996525s: None 2024-02-23T02:23:04.952816398Z [2024-02-23 02:23:04,951: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a11736f-b1e3-44f0-a051-b30753a9d88c] succeeded in 4.431546271000116s: None 2024-02-23T02:24:00.279104054Z [2024-02-23 02:24:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14c1f907-8f3c-4960-a2fc-be2ca2fd65da] received 2024-02-23T02:24:00.283070247Z [2024-02-23 02:24:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[438ac7af-01ca-4078-833f-ae814dfbcf08] received 2024-02-23T02:24:00.290155632Z [2024-02-23 02:24:00,289: INFO/ForkPoolWorker-15] [14c1f907-8f3c-4960-a2fc-be2ca2fd65da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:24:00.290684241Z [2024-02-23 02:24:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6947275-9a15-4a60-875a-8182c6a4b471] received 2024-02-23T02:24:00.297256225Z [2024-02-23 02:24:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df99187a-d3fb-4c66-ae7b-c37f80ea69d9] received 2024-02-23T02:24:00.299750316Z [2024-02-23 02:24:00,299: INFO/ForkPoolWorker-16] [438ac7af-01ca-4078-833f-ae814dfbcf08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:24:00.306732100Z [2024-02-23 02:24:00,306: INFO/ForkPoolWorker-2] [df99187a-d3fb-4c66-ae7b-c37f80ea69d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:24:00.309791437Z [2024-02-23 02:24:00,309: INFO/ForkPoolWorker-1] [e6947275-9a15-4a60-875a-8182c6a4b471] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:24:00.632576318Z [2024-02-23 02:24:00,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:24:00.729334904Z [2024-02-23 02:24:00,726: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:24:00.853720331Z [2024-02-23 02:24:00,850: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:24:00.915910394Z [2024-02-23 02:24:00,912: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:24:01.008244254Z [2024-02-23 02:24:01,007: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:24:01.101600418Z [2024-02-23 02:24:01,101: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:24:01.105761526Z [2024-02-23 02:24:01,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:24:01.156041358Z [2024-02-23 02:24:01,155: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:24:01.157586739Z [2024-02-23 02:24:01,157: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:24:01.157813557Z [2024-02-23 02:24:01,157: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:24:01.157908095Z [2024-02-23 02:24:01,157: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:24:01.158189059Z [2024-02-23 02:24:01,158: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:24:01.283719473Z [2024-02-23 02:24:01,283: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:24:01.864746461Z [2024-02-23 02:24:01,864: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[438ac7af-01ca-4078-833f-ae814dfbcf08] succeeded in 1.5780559239992726s: None 2024-02-23T02:24:02.076784104Z [2024-02-23 02:24:02,076: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6947275-9a15-4a60-875a-8182c6a4b471] succeeded in 1.7806879920008214s: None 2024-02-23T02:24:02.240940255Z [2024-02-23 02:24:02,240: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:24:02.244445638Z [2024-02-23 02:24:02,243: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:24:02.265926359Z [2024-02-23 02:24:02,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:24:02.267650926Z [2024-02-23 02:24:02,267: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:24:02.267980192Z [2024-02-23 02:24:02,267: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:24:02.268225891Z [2024-02-23 02:24:02,268: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:24:02.268374201Z [2024-02-23 02:24:02,268: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:24:02.269162863Z [2024-02-23 02:24:02,268: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:24:02.269319950Z [2024-02-23 02:24:02,269: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:24:02.279907965Z [2024-02-23 02:24:02,278: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:24:02.283398435Z [2024-02-23 02:24:02,282: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:24:02.305382853Z [2024-02-23 02:24:02,305: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:24:02.306760286Z [2024-02-23 02:24:02,306: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:24:02.307014638Z [2024-02-23 02:24:02,306: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:24:02.307240612Z [2024-02-23 02:24:02,307: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:24:02.307386071Z [2024-02-23 02:24:02,307: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:24:02.307744383Z [2024-02-23 02:24:02,307: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:24:02.307878074Z [2024-02-23 02:24:02,307: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:24:02.360217357Z [2024-02-23 02:24:02,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:24:02.404034731Z [2024-02-23 02:24:02,403: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:24:03.933176294Z [2024-02-23 02:24:03,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14c1f907-8f3c-4960-a2fc-be2ca2fd65da] succeeded in 3.652219948000493s: None 2024-02-23T02:24:04.608905146Z [2024-02-23 02:24:04,608: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df99187a-d3fb-4c66-ae7b-c37f80ea69d9] succeeded in 4.309519770000406s: None 2024-02-23T02:25:01.124322498Z [2024-02-23 02:25:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e5091d5-59c3-4273-9d9f-95a57d90310f] received 2024-02-23T02:25:01.129566248Z [2024-02-23 02:25:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[456e5ae5-53e6-400a-934d-4c362fd19512] received 2024-02-23T02:25:01.134755675Z [2024-02-23 02:25:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8df757cf-279b-4fbe-ae30-44b621dd974a] received 2024-02-23T02:25:01.138740214Z [2024-02-23 02:25:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33a71479-f1a4-4121-abdc-d71a960c07f4] received 2024-02-23T02:25:01.141034453Z [2024-02-23 02:25:01,140: INFO/ForkPoolWorker-15] [9e5091d5-59c3-4273-9d9f-95a57d90310f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:25:01.143880549Z [2024-02-23 02:25:01,143: INFO/ForkPoolWorker-1] [8df757cf-279b-4fbe-ae30-44b621dd974a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:25:01.149118575Z [2024-02-23 02:25:01,148: INFO/ForkPoolWorker-2] [33a71479-f1a4-4121-abdc-d71a960c07f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:25:01.149825552Z [2024-02-23 02:25:01,149: INFO/ForkPoolWorker-16] [456e5ae5-53e6-400a-934d-4c362fd19512] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:25:01.473804397Z [2024-02-23 02:25:01,470: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:25:01.528060496Z [2024-02-23 02:25:01,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:25:01.532181797Z [2024-02-23 02:25:01,529: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:25:01.666682684Z [2024-02-23 02:25:01,666: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:25:01.673238631Z [2024-02-23 02:25:01,672: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:01.696785426Z [2024-02-23 02:25:01,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:25:01.728614284Z [2024-02-23 02:25:01,728: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:25:01.729886046Z [2024-02-23 02:25:01,729: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:25:01.730100286Z [2024-02-23 02:25:01,729: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:25:01.730218843Z [2024-02-23 02:25:01,730: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:25:01.730491435Z [2024-02-23 02:25:01,730: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:25:01.842715470Z [2024-02-23 02:25:01,842: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:02.823281942Z [2024-02-23 02:25:02,822: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[33a71479-f1a4-4121-abdc-d71a960c07f4] succeeded in 1.682167348000803s: None 2024-02-23T02:25:03.106554094Z [2024-02-23 02:25:03,106: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:25:03.109948751Z [2024-02-23 02:25:03,109: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:03.137559552Z [2024-02-23 02:25:03,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:25:03.138842143Z [2024-02-23 02:25:03,138: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:25:03.138859753Z [2024-02-23 02:25:03,138: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:25:03.139068265Z [2024-02-23 02:25:03,138: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:25:03.139107560Z [2024-02-23 02:25:03,139: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:25:03.139350572Z [2024-02-23 02:25:03,139: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:25:03.139464420Z [2024-02-23 02:25:03,139: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:25:03.224730174Z [2024-02-23 02:25:03,224: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:03.283447855Z [2024-02-23 02:25:03,283: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:25:03.287091003Z [2024-02-23 02:25:03,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:03.311284667Z [2024-02-23 02:25:03,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:25:03.315063157Z [2024-02-23 02:25:03,312: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:25:03.315082720Z [2024-02-23 02:25:03,312: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:25:03.315087285Z [2024-02-23 02:25:03,313: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:25:03.315092357Z [2024-02-23 02:25:03,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:25:03.315095662Z [2024-02-23 02:25:03,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:25:03.315099038Z [2024-02-23 02:25:03,313: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:25:03.315102398Z [2024-02-23 02:25:03,313: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:25:03.318075442Z [2024-02-23 02:25:03,317: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:03.339732352Z [2024-02-23 02:25:03,339: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:25:03.341179275Z [2024-02-23 02:25:03,340: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:25:03.341348957Z [2024-02-23 02:25:03,341: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:25:03.341559722Z [2024-02-23 02:25:03,341: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:25:03.341703102Z [2024-02-23 02:25:03,341: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:25:03.342004523Z [2024-02-23 02:25:03,341: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:25:03.342076116Z [2024-02-23 02:25:03,341: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:25:03.429023962Z [2024-02-23 02:25:03,428: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:03.446038482Z [2024-02-23 02:25:03,445: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:04.066871323Z [2024-02-23 02:25:04,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e5091d5-59c3-4273-9d9f-95a57d90310f] succeeded in 2.9393152039992856s: None 2024-02-23T02:25:04.191454426Z [2024-02-23 02:25:04,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3e38d63-01c0-4677-b742-d7e9d8548441] received 2024-02-23T02:25:04.200009232Z [2024-02-23 02:25:04,199: INFO/ForkPoolWorker-15] [b3e38d63-01c0-4677-b742-d7e9d8548441] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:25:04.491805264Z [2024-02-23 02:25:04,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:25:04.812417690Z [2024-02-23 02:25:04,812: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8df757cf-279b-4fbe-ae30-44b621dd974a] succeeded in 3.674138292000862s: None 2024-02-23T02:25:05.598715459Z [2024-02-23 02:25:05,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[456e5ae5-53e6-400a-934d-4c362fd19512] succeeded in 4.461664186999769s: None 2024-02-23T02:25:05.977659083Z [2024-02-23 02:25:05,977: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:25:05.981481283Z [2024-02-23 02:25:05,980: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:05.999125218Z [2024-02-23 02:25:05,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:25:06.000474198Z [2024-02-23 02:25:06,000: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:25:06.003240188Z [2024-02-23 02:25:06,002: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:25:06.003525574Z [2024-02-23 02:25:06,003: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:25:06.004168549Z [2024-02-23 02:25:06,003: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:25:06.004677439Z [2024-02-23 02:25:06,004: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:25:06.005451901Z [2024-02-23 02:25:06,004: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:25:06.115445862Z [2024-02-23 02:25:06,115: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:06.686153296Z [2024-02-23 02:25:06,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac222a28-b494-4808-90fe-b06532a02438] received 2024-02-23T02:25:06.700421415Z [2024-02-23 02:25:06,700: INFO/ForkPoolWorker-16] [ac222a28-b494-4808-90fe-b06532a02438] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:25:06.741538136Z [2024-02-23 02:25:06,741: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3e38d63-01c0-4677-b742-d7e9d8548441] succeeded in 2.5486474690005707s: None 2024-02-23T02:25:06.990873947Z [2024-02-23 02:25:06,987: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:25:08.164959044Z [2024-02-23 02:25:08,164: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:25:08.168466875Z [2024-02-23 02:25:08,168: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:08.185898491Z [2024-02-23 02:25:08,185: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:25:08.187070749Z [2024-02-23 02:25:08,186: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:25:08.187173894Z [2024-02-23 02:25:08,187: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:25:08.187273942Z [2024-02-23 02:25:08,187: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:25:08.187373385Z [2024-02-23 02:25:08,187: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:25:08.187571261Z [2024-02-23 02:25:08,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:25:08.187651208Z [2024-02-23 02:25:08,187: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:25:08.283331449Z [2024-02-23 02:25:08,282: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:08.852847157Z [2024-02-23 02:25:08,852: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac222a28-b494-4808-90fe-b06532a02438] succeeded in 2.162102739999682s: None 2024-02-23T02:25:09.064941424Z [2024-02-23 02:25:09,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ec45c85-a1e2-4493-abdc-86bf54705c22] received 2024-02-23T02:25:09.090993573Z [2024-02-23 02:25:09,090: INFO/ForkPoolWorker-15] [0ec45c85-a1e2-4493-abdc-86bf54705c22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:25:09.391489668Z [2024-02-23 02:25:09,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:25:10.617724550Z [2024-02-23 02:25:10,617: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:25:10.620975495Z [2024-02-23 02:25:10,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:25:10.639195439Z [2024-02-23 02:25:10,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:25:10.640687689Z [2024-02-23 02:25:10,640: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:25:10.640761418Z [2024-02-23 02:25:10,640: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:25:10.640877830Z [2024-02-23 02:25:10,640: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:25:10.640951088Z [2024-02-23 02:25:10,640: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:25:10.641238067Z [2024-02-23 02:25:10,641: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:25:10.641304120Z [2024-02-23 02:25:10,641: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:25:10.726809368Z [2024-02-23 02:25:10,726: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:25:11.411262853Z [2024-02-23 02:25:11,410: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ec45c85-a1e2-4493-abdc-86bf54705c22] succeeded in 2.3432623589997092s: None 2024-02-23T02:26:01.144541794Z [2024-02-23 02:26:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa901a85-8560-4edf-9d23-fccc97c49077] received 2024-02-23T02:26:01.147762992Z [2024-02-23 02:26:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90927518-798b-460c-90c8-61339bff4703] received 2024-02-23T02:26:01.152796952Z [2024-02-23 02:26:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05e52955-e715-4792-b4d0-a0d8a9538880] received 2024-02-23T02:26:01.154008506Z [2024-02-23 02:26:01,153: INFO/ForkPoolWorker-15] [fa901a85-8560-4edf-9d23-fccc97c49077] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:26:01.155048903Z [2024-02-23 02:26:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8da8264-adc8-4cd1-9dfc-23cafebd200e] received 2024-02-23T02:26:01.161845901Z [2024-02-23 02:26:01,161: INFO/ForkPoolWorker-16] [90927518-798b-460c-90c8-61339bff4703] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:26:01.167260714Z [2024-02-23 02:26:01,166: INFO/ForkPoolWorker-1] [05e52955-e715-4792-b4d0-a0d8a9538880] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:26:01.167418423Z [2024-02-23 02:26:01,167: INFO/ForkPoolWorker-2] [b8da8264-adc8-4cd1-9dfc-23cafebd200e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:26:01.464630656Z [2024-02-23 02:26:01,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:26:01.530726325Z [2024-02-23 02:26:01,527: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:26:01.543026632Z [2024-02-23 02:26:01,539: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:26:01.654441472Z [2024-02-23 02:26:01,651: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:26:01.718637033Z [2024-02-23 02:26:01,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:26:01.738951172Z [2024-02-23 02:26:01,738: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:26:01.743231642Z [2024-02-23 02:26:01,742: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:26:01.778053184Z [2024-02-23 02:26:01,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:26:01.797825817Z [2024-02-23 02:26:01,797: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:26:01.798224094Z [2024-02-23 02:26:01,797: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:26:01.798388469Z [2024-02-23 02:26:01,798: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:26:01.798728886Z [2024-02-23 02:26:01,798: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:26:01.935472870Z [2024-02-23 02:26:01,935: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:26:02.343534311Z [2024-02-23 02:26:02,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa901a85-8560-4edf-9d23-fccc97c49077] succeeded in 1.1943366859995876s: None 2024-02-23T02:26:02.616577516Z [2024-02-23 02:26:02,616: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05e52955-e715-4792-b4d0-a0d8a9538880] succeeded in 1.4606702260007296s: None 2024-02-23T02:26:02.840674868Z [2024-02-23 02:26:02,840: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:26:02.844401797Z [2024-02-23 02:26:02,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:26:02.866480559Z [2024-02-23 02:26:02,866: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:26:02.867867775Z [2024-02-23 02:26:02,867: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:26:02.867886872Z [2024-02-23 02:26:02,867: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:26:02.868093033Z [2024-02-23 02:26:02,867: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:26:02.868199519Z [2024-02-23 02:26:02,868: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:26:02.868491041Z [2024-02-23 02:26:02,868: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:26:02.868607560Z [2024-02-23 02:26:02,868: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:26:02.961261839Z [2024-02-23 02:26:02,960: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:26:03.069721429Z [2024-02-23 02:26:03,069: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:26:03.073291669Z [2024-02-23 02:26:03,072: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:26:03.107656632Z [2024-02-23 02:26:03,107: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:26:03.108769711Z [2024-02-23 02:26:03,108: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:26:03.108832587Z [2024-02-23 02:26:03,108: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:26:03.108975733Z [2024-02-23 02:26:03,108: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:26:03.109084446Z [2024-02-23 02:26:03,108: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:26:03.109322193Z [2024-02-23 02:26:03,109: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:26:03.109394124Z [2024-02-23 02:26:03,109: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:26:03.209899675Z [2024-02-23 02:26:03,209: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:26:04.632920447Z [2024-02-23 02:26:04,632: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90927518-798b-460c-90c8-61339bff4703] succeeded in 3.4835572550000506s: None 2024-02-23T02:26:05.122959233Z [2024-02-23 02:26:05,122: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b8da8264-adc8-4cd1-9dfc-23cafebd200e] succeeded in 3.9656640510002035s: None 2024-02-23T02:27:00.264873351Z [2024-02-23 02:27:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d12a4c8f-a7d1-4589-adea-1a95a5eece5f] received 2024-02-23T02:27:00.266496851Z [2024-02-23 02:27:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e8c1805-60b3-4e37-b35c-c25ccc5fd672] received 2024-02-23T02:27:00.269578215Z [2024-02-23 02:27:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8b0c78f-5690-4c54-ab35-74197bde26c0] received 2024-02-23T02:27:00.272815921Z [2024-02-23 02:27:00,272: INFO/ForkPoolWorker-15] [d12a4c8f-a7d1-4589-adea-1a95a5eece5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:27:00.287056243Z [2024-02-23 02:27:00,286: INFO/ForkPoolWorker-1] [b8b0c78f-5690-4c54-ab35-74197bde26c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:27:00.287906000Z [2024-02-23 02:27:00,287: INFO/ForkPoolWorker-16] [1e8c1805-60b3-4e37-b35c-c25ccc5fd672] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:27:00.587151101Z [2024-02-23 02:27:00,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:27:00.603672750Z [2024-02-23 02:27:00,600: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:27:00.623538561Z [2024-02-23 02:27:00,620: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:27:00.800062971Z [2024-02-23 02:27:00,799: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:27:00.804532752Z [2024-02-23 02:27:00,804: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:27:00.855958086Z [2024-02-23 02:27:00,855: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:27:00.859850446Z [2024-02-23 02:27:00,859: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:27:00.859906769Z [2024-02-23 02:27:00,859: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:27:00.859927878Z [2024-02-23 02:27:00,859: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:27:00.860133620Z [2024-02-23 02:27:00,860: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:27:01.016452509Z [2024-02-23 02:27:01,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:27:01.598732747Z [2024-02-23 02:27:01,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e8c1805-60b3-4e37-b35c-c25ccc5fd672] succeeded in 1.3287573550005618s: None 2024-02-23T02:27:01.682086725Z [2024-02-23 02:27:01,681: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:27:01.685640244Z [2024-02-23 02:27:01,685: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:27:01.704617687Z [2024-02-23 02:27:01,704: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:27:01.705904496Z [2024-02-23 02:27:01,705: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:27:01.705917197Z [2024-02-23 02:27:01,705: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:27:01.706123644Z [2024-02-23 02:27:01,705: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:27:01.706267584Z [2024-02-23 02:27:01,706: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:27:01.706470945Z [2024-02-23 02:27:01,706: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:27:01.706481556Z [2024-02-23 02:27:01,706: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:27:01.752109625Z [2024-02-23 02:27:01,751: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:27:01.755383826Z [2024-02-23 02:27:01,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:27:01.773955745Z [2024-02-23 02:27:01,773: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:27:01.776809461Z [2024-02-23 02:27:01,776: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:27:01.776849905Z [2024-02-23 02:27:01,776: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:27:01.777053379Z [2024-02-23 02:27:01,776: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:27:01.777131877Z [2024-02-23 02:27:01,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:27:01.777402128Z [2024-02-23 02:27:01,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:27:01.777492857Z [2024-02-23 02:27:01,777: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:27:01.807450924Z [2024-02-23 02:27:01,807: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:27:01.853680789Z [2024-02-23 02:27:01,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:27:03.476143747Z [2024-02-23 02:27:03,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d12a4c8f-a7d1-4589-adea-1a95a5eece5f] succeeded in 3.2098687420002534s: None 2024-02-23T02:27:03.829117864Z [2024-02-23 02:27:03,828: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8b0c78f-5690-4c54-ab35-74197bde26c0] succeeded in 3.5569340149995696s: None 2024-02-23T02:28:00.303634886Z [2024-02-23 02:28:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b090769d-72cd-4e42-a470-13f61b809145] received 2024-02-23T02:28:00.305612050Z [2024-02-23 02:28:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a37d4528-6e34-47d5-b0b3-607546e2124a] received 2024-02-23T02:28:00.314722493Z [2024-02-23 02:28:00,314: INFO/ForkPoolWorker-15] [b090769d-72cd-4e42-a470-13f61b809145] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:28:00.315208029Z [2024-02-23 02:28:00,314: INFO/ForkPoolWorker-16] [a37d4528-6e34-47d5-b0b3-607546e2124a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:28:00.316323953Z [2024-02-23 02:28:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89ec4845-6924-427d-8643-93cf4bf16cd6] received 2024-02-23T02:28:00.318990954Z [2024-02-23 02:28:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4df01c36-95b9-4246-afe9-03f2394b32df] received 2024-02-23T02:28:00.324797285Z [2024-02-23 02:28:00,324: INFO/ForkPoolWorker-2] [4df01c36-95b9-4246-afe9-03f2394b32df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:28:00.327869412Z [2024-02-23 02:28:00,327: INFO/ForkPoolWorker-1] [89ec4845-6924-427d-8643-93cf4bf16cd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:28:00.600516511Z [2024-02-23 02:28:00,597: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:28:00.723336705Z [2024-02-23 02:28:00,712: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:28:00.733850254Z [2024-02-23 02:28:00,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:28:00.744992030Z [2024-02-23 02:28:00,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:28:00.798691297Z [2024-02-23 02:28:00,798: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:28:00.802571107Z [2024-02-23 02:28:00,802: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:28:00.856182424Z [2024-02-23 02:28:00,855: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:28:00.859924318Z [2024-02-23 02:28:00,859: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:28:00.860068414Z [2024-02-23 02:28:00,859: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:28:00.860172864Z [2024-02-23 02:28:00,860: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:28:00.860423279Z [2024-02-23 02:28:00,860: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:28:00.987164007Z [2024-02-23 02:28:00,986: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:28:01.190290213Z [2024-02-23 02:28:01,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:28:01.596205327Z [2024-02-23 02:28:01,595: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a37d4528-6e34-47d5-b0b3-607546e2124a] succeeded in 1.2890666530001909s: None 2024-02-23T02:28:01.784141381Z [2024-02-23 02:28:01,783: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89ec4845-6924-427d-8643-93cf4bf16cd6] succeeded in 1.4665354610006034s: None 2024-02-23T02:28:02.100604746Z [2024-02-23 02:28:02,100: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:28:02.103919444Z [2024-02-23 02:28:02,103: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:28:02.126476171Z [2024-02-23 02:28:02,126: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:28:02.128133021Z [2024-02-23 02:28:02,127: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:28:02.128838508Z [2024-02-23 02:28:02,128: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:28:02.129162411Z [2024-02-23 02:28:02,128: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:28:02.129380150Z [2024-02-23 02:28:02,129: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:28:02.129975191Z [2024-02-23 02:28:02,129: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:28:02.130185722Z [2024-02-23 02:28:02,129: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:28:02.170802484Z [2024-02-23 02:28:02,170: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:28:02.174152625Z [2024-02-23 02:28:02,173: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:28:02.197768113Z [2024-02-23 02:28:02,197: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:28:02.199304199Z [2024-02-23 02:28:02,199: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:28:02.199326404Z [2024-02-23 02:28:02,199: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:28:02.199470596Z [2024-02-23 02:28:02,199: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:28:02.199490202Z [2024-02-23 02:28:02,199: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:28:02.199824221Z [2024-02-23 02:28:02,199: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:28:02.199914990Z [2024-02-23 02:28:02,199: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:28:02.228184434Z [2024-02-23 02:28:02,227: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:28:02.309261300Z [2024-02-23 02:28:02,308: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:28:03.800588820Z [2024-02-23 02:28:03,799: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b090769d-72cd-4e42-a470-13f61b809145] succeeded in 3.4952734890011925s: None 2024-02-23T02:28:04.299763181Z [2024-02-23 02:28:04,299: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4df01c36-95b9-4246-afe9-03f2394b32df] succeeded in 3.979342639000606s: None 2024-02-23T02:29:00.306403989Z [2024-02-23 02:29:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[107e8c45-c426-419d-b158-9d186989e10d] received 2024-02-23T02:29:00.312217843Z [2024-02-23 02:29:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c71c1eac-dfd3-4d59-8baf-b0083d1822d5] received 2024-02-23T02:29:00.316492458Z [2024-02-23 02:29:00,316: INFO/ForkPoolWorker-15] [107e8c45-c426-419d-b158-9d186989e10d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:29:00.321757596Z [2024-02-23 02:29:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a892c7d4-f598-4560-a744-880476596297] received 2024-02-23T02:29:00.323176214Z [2024-02-23 02:29:00,322: INFO/ForkPoolWorker-16] [c71c1eac-dfd3-4d59-8baf-b0083d1822d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:29:00.335122383Z [2024-02-23 02:29:00,334: INFO/ForkPoolWorker-1] [a892c7d4-f598-4560-a744-880476596297] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:29:00.597279913Z [2024-02-23 02:29:00,594: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:29:00.657913584Z [2024-02-23 02:29:00,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:29:00.686915612Z [2024-02-23 02:29:00,683: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:29:00.762494990Z [2024-02-23 02:29:00,762: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T02:29:00.766300359Z [2024-02-23 02:29:00,765: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:29:00.784954551Z [2024-02-23 02:29:00,784: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:29:00.785847207Z [2024-02-23 02:29:00,785: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:29:00.785947305Z [2024-02-23 02:29:00,785: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:29:00.786022153Z [2024-02-23 02:29:00,785: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T02:29:00.786320823Z [2024-02-23 02:29:00,786: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:29:00.884771242Z [2024-02-23 02:29:00,884: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:29:01.512992204Z [2024-02-23 02:29:01,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[107e8c45-c426-419d-b158-9d186989e10d] succeeded in 1.204981814000348s: None 2024-02-23T02:29:01.830177967Z [2024-02-23 02:29:01,829: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:29:01.833329368Z [2024-02-23 02:29:01,832: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:29:01.859944009Z [2024-02-23 02:29:01,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:29:01.861664787Z [2024-02-23 02:29:01,861: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:29:01.861707706Z [2024-02-23 02:29:01,861: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:29:01.861935599Z [2024-02-23 02:29:01,861: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:29:01.861966021Z [2024-02-23 02:29:01,861: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:29:01.862272611Z [2024-02-23 02:29:01,862: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:29:01.862303222Z [2024-02-23 02:29:01,862: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:29:01.904683794Z [2024-02-23 02:29:01,904: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:29:01.908125933Z [2024-02-23 02:29:01,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:29:01.927994099Z [2024-02-23 02:29:01,927: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:29:01.929310913Z [2024-02-23 02:29:01,929: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:29:01.929337931Z [2024-02-23 02:29:01,929: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:29:01.929503910Z [2024-02-23 02:29:01,929: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:29:01.929526592Z [2024-02-23 02:29:01,929: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:29:01.929807162Z [2024-02-23 02:29:01,929: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:29:01.929906057Z [2024-02-23 02:29:01,929: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:29:01.971183761Z [2024-02-23 02:29:01,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:29:02.041321432Z [2024-02-23 02:29:02,041: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:29:03.648873923Z [2024-02-23 02:29:03,648: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c71c1eac-dfd3-4d59-8baf-b0083d1822d5] succeeded in 3.333267808000528s: None 2024-02-23T02:29:03.892132615Z [2024-02-23 02:29:03,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a892c7d4-f598-4560-a744-880476596297] succeeded in 3.5685402220005926s: None 2024-02-23T02:30:01.273162258Z [2024-02-23 02:30:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cffc256-9cf9-4a77-baa4-b74502d13776] received 2024-02-23T02:30:01.276802012Z [2024-02-23 02:30:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c647dc43-e161-4962-893b-8afccb347aba] received 2024-02-23T02:30:01.279244640Z [2024-02-23 02:30:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37d4811d-2ac3-4758-b1f5-27c7c9488817] received 2024-02-23T02:30:01.280544282Z [2024-02-23 02:30:01,280: INFO/ForkPoolWorker-15] [4cffc256-9cf9-4a77-baa4-b74502d13776] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:30:01.282982335Z [2024-02-23 02:30:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6733c5b1-a149-40a3-87c5-84ff95558b62] received 2024-02-23T02:30:01.287702472Z [2024-02-23 02:30:01,287: INFO/ForkPoolWorker-16] [c647dc43-e161-4962-893b-8afccb347aba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:30:01.288308557Z [2024-02-23 02:30:01,288: INFO/ForkPoolWorker-1] [37d4811d-2ac3-4758-b1f5-27c7c9488817] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:30:01.294323574Z [2024-02-23 02:30:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[695cfc36-02b5-4da1-ad07-1239eb34a7c5] received 2024-02-23T02:30:01.296119515Z [2024-02-23 02:30:01,295: INFO/ForkPoolWorker-2] [6733c5b1-a149-40a3-87c5-84ff95558b62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:30:01.311636654Z [2024-02-23 02:30:01,311: INFO/ForkPoolWorker-3] [695cfc36-02b5-4da1-ad07-1239eb34a7c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:30:01.648754859Z [2024-02-23 02:30:01,645: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:30:01.671610324Z [2024-02-23 02:30:01,668: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:30:01.894189169Z [2024-02-23 02:30:01,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:30:01.982072038Z [2024-02-23 02:30:01,977: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:30:01.986465437Z [2024-02-23 02:30:01,983: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:30:02.069718191Z [2024-02-23 02:30:02,069: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T02:30:02.073822442Z [2024-02-23 02:30:02,073: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:02.108170535Z [2024-02-23 02:30:02,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:30:02.109566592Z [2024-02-23 02:30:02,109: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:30:02.109719787Z [2024-02-23 02:30:02,109: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:30:02.109832748Z [2024-02-23 02:30:02,109: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T02:30:02.110132907Z [2024-02-23 02:30:02,109: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:30:02.247200896Z [2024-02-23 02:30:02,246: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:02.418374894Z [2024-02-23 02:30:02,418: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:03.004833866Z [2024-02-23 02:30:03,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cffc256-9cf9-4a77-baa4-b74502d13776] succeeded in 1.7297168459990644s: None 2024-02-23T02:30:03.280607505Z [2024-02-23 02:30:03,280: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[695cfc36-02b5-4da1-ad07-1239eb34a7c5] succeeded in 1.9838832309997088s: None 2024-02-23T02:30:03.303404857Z [2024-02-23 02:30:03,303: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:30:03.306729385Z [2024-02-23 02:30:03,306: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:03.336633135Z [2024-02-23 02:30:03,336: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:30:03.339012695Z [2024-02-23 02:30:03,338: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:30:03.339246742Z [2024-02-23 02:30:03,339: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:30:03.339504845Z [2024-02-23 02:30:03,339: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:30:03.339614936Z [2024-02-23 02:30:03,339: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:30:03.339957159Z [2024-02-23 02:30:03,339: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:30:03.340115491Z [2024-02-23 02:30:03,339: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:30:03.376614672Z [2024-02-23 02:30:03,376: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:30:03.389659847Z [2024-02-23 02:30:03,389: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:03.423583798Z [2024-02-23 02:30:03,423: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:30:03.425219008Z [2024-02-23 02:30:03,424: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:30:03.425402447Z [2024-02-23 02:30:03,425: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:30:03.425775145Z [2024-02-23 02:30:03,425: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:30:03.426069962Z [2024-02-23 02:30:03,425: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:30:03.426535342Z [2024-02-23 02:30:03,426: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:30:03.429108381Z [2024-02-23 02:30:03,426: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:30:03.450975484Z [2024-02-23 02:30:03,450: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:03.451796682Z [2024-02-23 02:30:03,451: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:30:03.455638630Z [2024-02-23 02:30:03,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:03.477426112Z [2024-02-23 02:30:03,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:30:03.478733343Z [2024-02-23 02:30:03,478: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:30:03.478960839Z [2024-02-23 02:30:03,478: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:30:03.479183246Z [2024-02-23 02:30:03,478: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:30:03.479299917Z [2024-02-23 02:30:03,479: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:30:03.479606846Z [2024-02-23 02:30:03,479: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:30:03.479635454Z [2024-02-23 02:30:03,479: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:30:03.543450736Z [2024-02-23 02:30:03,543: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:03.578971965Z [2024-02-23 02:30:03,578: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:04.189613906Z [2024-02-23 02:30:04,189: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37d4811d-2ac3-4758-b1f5-27c7c9488817] succeeded in 2.908382690999133s: None 2024-02-23T02:30:05.211757542Z [2024-02-23 02:30:05,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92d1f2a8-8913-45bf-bba5-435775f983a6] received 2024-02-23T02:30:05.228288419Z [2024-02-23 02:30:05,227: INFO/ForkPoolWorker-15] [92d1f2a8-8913-45bf-bba5-435775f983a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:30:05.282582695Z [2024-02-23 02:30:05,281: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6733c5b1-a149-40a3-87c5-84ff95558b62] succeeded in 3.9961914460000116s: None 2024-02-23T02:30:05.540837494Z [2024-02-23 02:30:05,533: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:30:05.622494127Z [2024-02-23 02:30:05,621: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c647dc43-e161-4962-893b-8afccb347aba] succeeded in 4.343902131000505s: None 2024-02-23T02:30:06.963740261Z [2024-02-23 02:30:06,963: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:30:06.967277519Z [2024-02-23 02:30:06,966: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:06.987894964Z [2024-02-23 02:30:06,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:30:06.989474467Z [2024-02-23 02:30:06,989: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:30:06.989619647Z [2024-02-23 02:30:06,989: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:30:06.989833599Z [2024-02-23 02:30:06,989: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:30:06.989974992Z [2024-02-23 02:30:06,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:30:06.990390846Z [2024-02-23 02:30:06,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:30:06.990591287Z [2024-02-23 02:30:06,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:30:07.098472832Z [2024-02-23 02:30:07,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:07.696055289Z [2024-02-23 02:30:07,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92d1f2a8-8913-45bf-bba5-435775f983a6] succeeded in 2.4823444560006465s: None 2024-02-23T02:30:08.207542007Z [2024-02-23 02:30:08,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d78cc04-a499-4bd3-b020-53fff6aea96c] received 2024-02-23T02:30:08.216917637Z [2024-02-23 02:30:08,216: INFO/ForkPoolWorker-15] [2d78cc04-a499-4bd3-b020-53fff6aea96c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:30:08.492663964Z [2024-02-23 02:30:08,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:30:09.567853386Z [2024-02-23 02:30:09,567: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:30:09.571170699Z [2024-02-23 02:30:09,570: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:09.595062134Z [2024-02-23 02:30:09,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:30:09.596569860Z [2024-02-23 02:30:09,596: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:30:09.596725401Z [2024-02-23 02:30:09,596: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:30:09.596978315Z [2024-02-23 02:30:09,596: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:30:09.597119443Z [2024-02-23 02:30:09,596: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:30:09.597465374Z [2024-02-23 02:30:09,597: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:30:09.597614675Z [2024-02-23 02:30:09,597: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:30:09.731500506Z [2024-02-23 02:30:09,731: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:10.426445011Z [2024-02-23 02:30:10,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d78cc04-a499-4bd3-b020-53fff6aea96c] succeeded in 2.2160072900005616s: None 2024-02-23T02:30:11.368787135Z [2024-02-23 02:30:11,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee148f56-9b3c-4723-9d9f-48657bba90d3] received 2024-02-23T02:30:11.375021707Z [2024-02-23 02:30:11,374: INFO/ForkPoolWorker-15] [ee148f56-9b3c-4723-9d9f-48657bba90d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:30:11.645991515Z [2024-02-23 02:30:11,643: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:30:12.748639469Z [2024-02-23 02:30:12,748: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:30:12.752069092Z [2024-02-23 02:30:12,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:30:12.771550950Z [2024-02-23 02:30:12,771: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:30:12.773516447Z [2024-02-23 02:30:12,773: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:30:12.773845874Z [2024-02-23 02:30:12,773: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:30:12.774183831Z [2024-02-23 02:30:12,773: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:30:12.774415928Z [2024-02-23 02:30:12,774: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:30:12.774993219Z [2024-02-23 02:30:12,774: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:30:12.775232102Z [2024-02-23 02:30:12,775: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:30:12.862688902Z [2024-02-23 02:30:12,862: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:30:13.412105498Z [2024-02-23 02:30:13,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee148f56-9b3c-4723-9d9f-48657bba90d3] succeeded in 2.0411929030015017s: None 2024-02-23T02:31:01.100945750Z [2024-02-23 02:31:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bd5e79d-2288-4a22-bd7d-dc18a01644ae] received 2024-02-23T02:31:01.108443468Z [2024-02-23 02:31:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab70a26e-b823-4cd5-bf58-3cc58cccb7a9] received 2024-02-23T02:31:01.114382835Z [2024-02-23 02:31:01,114: INFO/ForkPoolWorker-15] [6bd5e79d-2288-4a22-bd7d-dc18a01644ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:31:01.115631255Z [2024-02-23 02:31:01,115: INFO/ForkPoolWorker-16] [ab70a26e-b823-4cd5-bf58-3cc58cccb7a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:31:01.125233776Z [2024-02-23 02:31:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf709404-fe8b-4c69-aa93-d881f947bce7] received 2024-02-23T02:31:01.134202055Z [2024-02-23 02:31:01,133: INFO/ForkPoolWorker-1] [cf709404-fe8b-4c69-aa93-d881f947bce7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:31:01.412301715Z [2024-02-23 02:31:01,409: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:31:01.417842975Z [2024-02-23 02:31:01,414: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:31:01.455599451Z [2024-02-23 02:31:01,451: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:31:01.601274715Z [2024-02-23 02:31:01,600: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:31:01.605151082Z [2024-02-23 02:31:01,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:31:01.625776142Z [2024-02-23 02:31:01,625: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:31:01.626908823Z [2024-02-23 02:31:01,626: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:31:01.627082857Z [2024-02-23 02:31:01,626: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:31:01.627213280Z [2024-02-23 02:31:01,627: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:31:01.627488943Z [2024-02-23 02:31:01,627: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:31:01.734171388Z [2024-02-23 02:31:01,733: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:31:02.441245078Z [2024-02-23 02:31:02,440: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab70a26e-b823-4cd5-bf58-3cc58cccb7a9] succeeded in 1.3308595739999873s: None 2024-02-23T02:31:02.594346582Z [2024-02-23 02:31:02,593: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:31:02.597941919Z [2024-02-23 02:31:02,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:31:02.617661666Z [2024-02-23 02:31:02,617: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:31:02.619126410Z [2024-02-23 02:31:02,618: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:31:02.619271967Z [2024-02-23 02:31:02,619: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:31:02.619468630Z [2024-02-23 02:31:02,619: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:31:02.620023581Z [2024-02-23 02:31:02,619: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:31:02.620582181Z [2024-02-23 02:31:02,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:31:02.621298265Z [2024-02-23 02:31:02,621: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:31:02.695488201Z [2024-02-23 02:31:02,695: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:31:02.698784209Z [2024-02-23 02:31:02,698: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:31:02.711697946Z [2024-02-23 02:31:02,711: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:31:02.729038555Z [2024-02-23 02:31:02,728: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:31:02.730596117Z [2024-02-23 02:31:02,730: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:31:02.730618850Z [2024-02-23 02:31:02,730: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:31:02.730743549Z [2024-02-23 02:31:02,730: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:31:02.730801186Z [2024-02-23 02:31:02,730: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:31:02.731114421Z [2024-02-23 02:31:02,730: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:31:02.731190518Z [2024-02-23 02:31:02,731: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:31:02.825461721Z [2024-02-23 02:31:02,825: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:31:04.447430462Z [2024-02-23 02:31:04,446: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf709404-fe8b-4c69-aa93-d881f947bce7] succeeded in 3.32014658099979s: None 2024-02-23T02:31:05.442821438Z [2024-02-23 02:31:05,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6bd5e79d-2288-4a22-bd7d-dc18a01644ae] succeeded in 4.339687141999093s: None 2024-02-23T02:32:00.984601885Z [2024-02-23 02:32:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e323c0d9-25c1-44fa-9619-5ec2d58c2c34] received 2024-02-23T02:32:00.991799639Z [2024-02-23 02:32:00,991: INFO/ForkPoolWorker-15] [e323c0d9-25c1-44fa-9619-5ec2d58c2c34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:32:01.003629685Z [2024-02-23 02:32:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c091dbc5-72fa-4df4-8044-709af4e88d14] received 2024-02-23T02:32:01.008053861Z [2024-02-23 02:32:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46a6f08d-18e2-488f-bd32-7c1a7d570676] received 2024-02-23T02:32:01.009851661Z [2024-02-23 02:32:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b948ac94-8fe0-4efd-bd70-370c04bc9680] received 2024-02-23T02:32:01.021434246Z [2024-02-23 02:32:01,021: INFO/ForkPoolWorker-16] [c091dbc5-72fa-4df4-8044-709af4e88d14] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:32:01.021466818Z [2024-02-23 02:32:01,021: INFO/ForkPoolWorker-2] [b948ac94-8fe0-4efd-bd70-370c04bc9680] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:32:01.024166754Z [2024-02-23 02:32:01,021: INFO/ForkPoolWorker-1] [46a6f08d-18e2-488f-bd32-7c1a7d570676] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:32:01.289677106Z [2024-02-23 02:32:01,286: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:32:01.334695830Z [2024-02-23 02:32:01,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:32:01.366485211Z [2024-02-23 02:32:01,362: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:32:01.480939730Z [2024-02-23 02:32:01,480: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:32:01.494321316Z [2024-02-23 02:32:01,490: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:32:01.527351003Z [2024-02-23 02:32:01,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:32:01.532943377Z [2024-02-23 02:32:01,532: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:32:01.533880749Z [2024-02-23 02:32:01,533: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:32:01.533939334Z [2024-02-23 02:32:01,533: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:32:01.533981451Z [2024-02-23 02:32:01,533: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:32:01.534147343Z [2024-02-23 02:32:01,534: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:32:01.638071549Z [2024-02-23 02:32:01,637: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:32:01.865722769Z [2024-02-23 02:32:01,865: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:32:02.349550410Z [2024-02-23 02:32:02,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b948ac94-8fe0-4efd-bd70-370c04bc9680] succeeded in 1.3364780390002124s: None 2024-02-23T02:32:02.508265720Z [2024-02-23 02:32:02,507: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c091dbc5-72fa-4df4-8044-709af4e88d14] succeeded in 1.5017745660006767s: None 2024-02-23T02:32:02.672310751Z [2024-02-23 02:32:02,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:32:02.675855977Z [2024-02-23 02:32:02,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:32:02.698667252Z [2024-02-23 02:32:02,698: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:32:02.700277331Z [2024-02-23 02:32:02,700: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:32:02.700556860Z [2024-02-23 02:32:02,700: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:32:02.700837730Z [2024-02-23 02:32:02,700: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:32:02.701038221Z [2024-02-23 02:32:02,700: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:32:02.701434626Z [2024-02-23 02:32:02,701: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:32:02.701640480Z [2024-02-23 02:32:02,701: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:32:02.797695589Z [2024-02-23 02:32:02,797: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:32:02.810295700Z [2024-02-23 02:32:02,809: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:32:02.813577167Z [2024-02-23 02:32:02,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:32:02.835199500Z [2024-02-23 02:32:02,834: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:32:02.836486439Z [2024-02-23 02:32:02,836: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:32:02.836504962Z [2024-02-23 02:32:02,836: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:32:02.836619483Z [2024-02-23 02:32:02,836: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:32:02.836660790Z [2024-02-23 02:32:02,836: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:32:02.836960139Z [2024-02-23 02:32:02,836: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:32:02.837000832Z [2024-02-23 02:32:02,836: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:32:02.921833727Z [2024-02-23 02:32:02,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:32:04.508646861Z [2024-02-23 02:32:04,508: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e323c0d9-25c1-44fa-9619-5ec2d58c2c34] succeeded in 3.522412890999476s: None 2024-02-23T02:32:05.194873336Z [2024-02-23 02:32:05,194: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46a6f08d-18e2-488f-bd32-7c1a7d570676] succeeded in 4.184172486000534s: None 2024-02-23T02:33:00.636109584Z [2024-02-23 02:33:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3ee0b05-bece-47ff-a408-8823a24d1695] received 2024-02-23T02:33:00.646066648Z [2024-02-23 02:33:00,645: INFO/ForkPoolWorker-15] [e3ee0b05-bece-47ff-a408-8823a24d1695] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:33:00.658713975Z [2024-02-23 02:33:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17259802-f1b3-4ef6-a358-48468cd77b32] received 2024-02-23T02:33:00.664266769Z [2024-02-23 02:33:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed353d8f-fffb-47f8-b9d7-00657f46e320] received 2024-02-23T02:33:00.666928031Z [2024-02-23 02:33:00,666: INFO/ForkPoolWorker-16] [17259802-f1b3-4ef6-a358-48468cd77b32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:33:00.672592170Z [2024-02-23 02:33:00,672: INFO/ForkPoolWorker-1] [ed353d8f-fffb-47f8-b9d7-00657f46e320] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:33:00.966585894Z [2024-02-23 02:33:00,963: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:33:01.057418576Z [2024-02-23 02:33:01,054: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:33:01.071566535Z [2024-02-23 02:33:01,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:33:01.296109882Z [2024-02-23 02:33:01,295: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T02:33:01.303073069Z [2024-02-23 02:33:01,302: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:33:01.348644157Z [2024-02-23 02:33:01,348: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:33:01.351140880Z [2024-02-23 02:33:01,350: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:33:01.351467468Z [2024-02-23 02:33:01,351: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:33:01.351774955Z [2024-02-23 02:33:01,351: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T02:33:01.352847166Z [2024-02-23 02:33:01,352: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:33:01.446190637Z [2024-02-23 02:33:01,445: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:33:02.277540931Z [2024-02-23 02:33:02,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3ee0b05-bece-47ff-a408-8823a24d1695] succeeded in 1.6394928879999497s: None 2024-02-23T02:33:02.610698602Z [2024-02-23 02:33:02,610: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:33:02.614804073Z [2024-02-23 02:33:02,614: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:33:02.649506802Z [2024-02-23 02:33:02,649: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:33:02.651865190Z [2024-02-23 02:33:02,651: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:33:02.651897127Z [2024-02-23 02:33:02,651: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:33:02.652129783Z [2024-02-23 02:33:02,651: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:33:02.652364882Z [2024-02-23 02:33:02,652: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:33:02.652726898Z [2024-02-23 02:33:02,652: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:33:02.652881689Z [2024-02-23 02:33:02,652: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:33:02.760581457Z [2024-02-23 02:33:02,760: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:33:02.767506253Z [2024-02-23 02:33:02,767: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:33:02.771590412Z [2024-02-23 02:33:02,770: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:33:02.817891856Z [2024-02-23 02:33:02,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:33:02.821238697Z [2024-02-23 02:33:02,820: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:33:02.821597807Z [2024-02-23 02:33:02,821: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:33:02.821952771Z [2024-02-23 02:33:02,821: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:33:02.822309896Z [2024-02-23 02:33:02,822: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:33:02.822915391Z [2024-02-23 02:33:02,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:33:02.823890889Z [2024-02-23 02:33:02,823: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:33:02.934449402Z [2024-02-23 02:33:02,934: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:33:04.897973793Z [2024-02-23 02:33:04,897: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17259802-f1b3-4ef6-a358-48468cd77b32] succeeded in 4.237410701000044s: None 2024-02-23T02:33:04.908992723Z [2024-02-23 02:33:04,908: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed353d8f-fffb-47f8-b9d7-00657f46e320] succeeded in 4.243295094000132s: None 2024-02-23T02:34:00.784436726Z [2024-02-23 02:34:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f09cf65-80f2-4571-922a-5a089eb6042c] received 2024-02-23T02:34:00.790500130Z [2024-02-23 02:34:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6f000be-ef42-4545-9d3e-4e0c837a21d1] received 2024-02-23T02:34:00.792211387Z [2024-02-23 02:34:00,791: INFO/ForkPoolWorker-15] [7f09cf65-80f2-4571-922a-5a089eb6042c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:34:00.796455793Z [2024-02-23 02:34:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f80d13a7-db3e-48e3-8436-dad7a161a166] received 2024-02-23T02:34:00.801655703Z [2024-02-23 02:34:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c720438-0eeb-4a84-807c-6df3cfca2b8f] received 2024-02-23T02:34:00.809540291Z [2024-02-23 02:34:00,808: INFO/ForkPoolWorker-1] [f80d13a7-db3e-48e3-8436-dad7a161a166] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:34:00.813494445Z [2024-02-23 02:34:00,813: INFO/ForkPoolWorker-16] [f6f000be-ef42-4545-9d3e-4e0c837a21d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:34:00.818500687Z [2024-02-23 02:34:00,818: INFO/ForkPoolWorker-2] [4c720438-0eeb-4a84-807c-6df3cfca2b8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:34:01.132311939Z [2024-02-23 02:34:01,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:34:01.146177274Z [2024-02-23 02:34:01,143: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:34:01.154936784Z [2024-02-23 02:34:01,150: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:34:01.198395189Z [2024-02-23 02:34:01,195: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:34:01.320116263Z [2024-02-23 02:34:01,319: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:34:01.324796263Z [2024-02-23 02:34:01,324: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:34:01.352993917Z [2024-02-23 02:34:01,352: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:34:01.358505171Z [2024-02-23 02:34:01,358: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:34:01.358566072Z [2024-02-23 02:34:01,358: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:34:01.358651746Z [2024-02-23 02:34:01,358: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:34:01.358949332Z [2024-02-23 02:34:01,358: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:34:01.468864155Z [2024-02-23 02:34:01,468: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:34:01.513968562Z [2024-02-23 02:34:01,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:34:02.023419562Z [2024-02-23 02:34:02,022: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f80d13a7-db3e-48e3-8436-dad7a161a166] succeeded in 1.225079319001452s: None 2024-02-23T02:34:02.166993495Z [2024-02-23 02:34:02,166: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6f000be-ef42-4545-9d3e-4e0c837a21d1] succeeded in 1.37333351199959s: None 2024-02-23T02:34:02.496018209Z [2024-02-23 02:34:02,495: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:34:02.499430399Z [2024-02-23 02:34:02,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:34:02.519448682Z [2024-02-23 02:34:02,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:34:02.521335516Z [2024-02-23 02:34:02,521: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:34:02.521449137Z [2024-02-23 02:34:02,521: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:34:02.521608607Z [2024-02-23 02:34:02,521: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:34:02.521698776Z [2024-02-23 02:34:02,521: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:34:02.521959829Z [2024-02-23 02:34:02,521: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:34:02.522061191Z [2024-02-23 02:34:02,521: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:34:02.572348854Z [2024-02-23 02:34:02,571: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:34:02.575606832Z [2024-02-23 02:34:02,575: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:34:02.611512076Z [2024-02-23 02:34:02,611: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:34:02.613101402Z [2024-02-23 02:34:02,612: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:34:02.613159359Z [2024-02-23 02:34:02,613: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:34:02.613339315Z [2024-02-23 02:34:02,613: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:34:02.613353281Z [2024-02-23 02:34:02,613: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:34:02.613732071Z [2024-02-23 02:34:02,613: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:34:02.613833970Z [2024-02-23 02:34:02,613: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:34:02.633690600Z [2024-02-23 02:34:02,633: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:34:02.769598250Z [2024-02-23 02:34:02,769: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:34:04.282287983Z [2024-02-23 02:34:04,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f09cf65-80f2-4571-922a-5a089eb6042c] succeeded in 3.494495390999873s: None 2024-02-23T02:34:04.937601485Z [2024-02-23 02:34:04,937: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4c720438-0eeb-4a84-807c-6df3cfca2b8f] succeeded in 4.1307171440003s: None 2024-02-23T02:35:00.872441978Z [2024-02-23 02:35:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e43feaf2-d2d0-46b6-ab73-f92fff1c2cfd] received 2024-02-23T02:35:00.880129296Z [2024-02-23 02:35:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c03dca0-cad4-4b92-83d7-55e65f8ebcc9] received 2024-02-23T02:35:00.883795050Z [2024-02-23 02:35:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0239134b-b9a6-4c90-b2a7-e44d9c089916] received 2024-02-23T02:35:00.892275494Z [2024-02-23 02:35:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5aea549-65c8-4643-885d-ce7936c6bbe6] received 2024-02-23T02:35:00.892888623Z [2024-02-23 02:35:00,892: INFO/ForkPoolWorker-16] [3c03dca0-cad4-4b92-83d7-55e65f8ebcc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:35:00.901666485Z [2024-02-23 02:35:00,901: INFO/ForkPoolWorker-15] [e43feaf2-d2d0-46b6-ab73-f92fff1c2cfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:35:00.902348022Z [2024-02-23 02:35:00,902: INFO/ForkPoolWorker-1] [0239134b-b9a6-4c90-b2a7-e44d9c089916] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:35:00.904689062Z [2024-02-23 02:35:00,904: INFO/ForkPoolWorker-2] [d5aea549-65c8-4643-885d-ce7936c6bbe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:35:01.241779668Z [2024-02-23 02:35:01,238: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:35:01.252581051Z [2024-02-23 02:35:01,240: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:35:01.317756615Z [2024-02-23 02:35:01,294: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:35:01.351709155Z [2024-02-23 02:35:01,348: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:35:01.421639687Z [2024-02-23 02:35:01,421: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:35:01.425406902Z [2024-02-23 02:35:01,424: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:01.447892798Z [2024-02-23 02:35:01,447: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:35:01.449115623Z [2024-02-23 02:35:01,448: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:35:01.449360990Z [2024-02-23 02:35:01,449: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:35:01.449462729Z [2024-02-23 02:35:01,449: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:35:01.449791050Z [2024-02-23 02:35:01,449: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:35:01.597294414Z [2024-02-23 02:35:01,596: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:02.206112508Z [2024-02-23 02:35:02,205: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3c03dca0-cad4-4b92-83d7-55e65f8ebcc9] succeeded in 1.3210136420002527s: None 2024-02-23T02:35:02.514088436Z [2024-02-23 02:35:02,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:35:02.517740467Z [2024-02-23 02:35:02,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:02.546074976Z [2024-02-23 02:35:02,545: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:35:02.548558508Z [2024-02-23 02:35:02,548: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:35:02.548778877Z [2024-02-23 02:35:02,548: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:35:02.549063842Z [2024-02-23 02:35:02,548: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:35:02.549206536Z [2024-02-23 02:35:02,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:35:02.549789675Z [2024-02-23 02:35:02,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:35:02.549958755Z [2024-02-23 02:35:02,549: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:35:02.609259932Z [2024-02-23 02:35:02,608: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:35:02.611063456Z [2024-02-23 02:35:02,610: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:35:02.612541412Z [2024-02-23 02:35:02,612: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:02.617525649Z [2024-02-23 02:35:02,613: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:02.630209854Z [2024-02-23 02:35:02,629: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:35:02.631800755Z [2024-02-23 02:35:02,631: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:35:02.631817304Z [2024-02-23 02:35:02,631: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:35:02.632057013Z [2024-02-23 02:35:02,631: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:35:02.632068294Z [2024-02-23 02:35:02,631: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:35:02.632418631Z [2024-02-23 02:35:02,632: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:35:02.632431631Z [2024-02-23 02:35:02,632: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:35:02.650403709Z [2024-02-23 02:35:02,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:35:02.652708309Z [2024-02-23 02:35:02,652: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:35:02.652841201Z [2024-02-23 02:35:02,652: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:35:02.652974701Z [2024-02-23 02:35:02,652: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:35:02.653005457Z [2024-02-23 02:35:02,652: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:35:02.653527259Z [2024-02-23 02:35:02,653: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:35:02.653541435Z [2024-02-23 02:35:02,653: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:35:02.671819466Z [2024-02-23 02:35:02,671: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:02.739706324Z [2024-02-23 02:35:02,739: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:02.761426374Z [2024-02-23 02:35:02,761: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:03.436028930Z [2024-02-23 02:35:03,435: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0239134b-b9a6-4c90-b2a7-e44d9c089916] succeeded in 2.547831273999691s: None 2024-02-23T02:35:03.675751308Z [2024-02-23 02:35:03,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34e0dc28-c34f-499d-8930-4c8819f1824c] received 2024-02-23T02:35:03.688696132Z [2024-02-23 02:35:03,688: INFO/ForkPoolWorker-16] [34e0dc28-c34f-499d-8930-4c8819f1824c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:35:04.003006050Z [2024-02-23 02:35:03,999: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:35:04.140509790Z [2024-02-23 02:35:04,139: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e43feaf2-d2d0-46b6-ab73-f92fff1c2cfd] succeeded in 3.2590264459995524s: None 2024-02-23T02:35:04.594444429Z [2024-02-23 02:35:04,594: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5aea549-65c8-4643-885d-ce7936c6bbe6] succeeded in 3.6998994580008002s: None 2024-02-23T02:35:05.395168224Z [2024-02-23 02:35:05,394: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:35:05.398330914Z [2024-02-23 02:35:05,397: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:05.420221969Z [2024-02-23 02:35:05,419: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:35:05.421788085Z [2024-02-23 02:35:05,421: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:35:05.421802902Z [2024-02-23 02:35:05,421: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:35:05.421821445Z [2024-02-23 02:35:05,421: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:35:05.421996344Z [2024-02-23 02:35:05,421: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:35:05.422080373Z [2024-02-23 02:35:05,421: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:35:05.422088514Z [2024-02-23 02:35:05,421: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:35:05.516904416Z [2024-02-23 02:35:05,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:06.328777726Z [2024-02-23 02:35:06,327: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[34e0dc28-c34f-499d-8930-4c8819f1824c] succeeded in 2.650446029001614s: None 2024-02-23T02:35:07.014924270Z [2024-02-23 02:35:07,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[476a15bd-8427-4b5b-ac96-b9e2d511facf] received 2024-02-23T02:35:07.026372085Z [2024-02-23 02:35:07,025: INFO/ForkPoolWorker-15] [476a15bd-8427-4b5b-ac96-b9e2d511facf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:35:07.385905444Z [2024-02-23 02:35:07,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:35:08.589904935Z [2024-02-23 02:35:08,589: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:35:08.593619080Z [2024-02-23 02:35:08,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:08.617570840Z [2024-02-23 02:35:08,617: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:35:08.619191132Z [2024-02-23 02:35:08,618: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:35:08.619425930Z [2024-02-23 02:35:08,619: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:35:08.619688167Z [2024-02-23 02:35:08,619: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:35:08.619870228Z [2024-02-23 02:35:08,619: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:35:08.620295929Z [2024-02-23 02:35:08,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:35:08.620902633Z [2024-02-23 02:35:08,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:35:08.719057129Z [2024-02-23 02:35:08,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:09.321248326Z [2024-02-23 02:35:09,320: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[476a15bd-8427-4b5b-ac96-b9e2d511facf] succeeded in 2.302237124000385s: None 2024-02-23T02:35:09.916682170Z [2024-02-23 02:35:09,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f2be43e-e18c-43a3-87b7-ad05ce71f6ec] received 2024-02-23T02:35:09.939594994Z [2024-02-23 02:35:09,939: INFO/ForkPoolWorker-15] [8f2be43e-e18c-43a3-87b7-ad05ce71f6ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:35:10.334886417Z [2024-02-23 02:35:10,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:35:11.415850188Z [2024-02-23 02:35:11,415: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:35:11.419088336Z [2024-02-23 02:35:11,418: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:35:11.438089184Z [2024-02-23 02:35:11,437: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:35:11.439521871Z [2024-02-23 02:35:11,439: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:35:11.439648923Z [2024-02-23 02:35:11,439: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:35:11.439912178Z [2024-02-23 02:35:11,439: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:35:11.440035730Z [2024-02-23 02:35:11,439: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:35:11.440515339Z [2024-02-23 02:35:11,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:35:11.440691324Z [2024-02-23 02:35:11,440: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:35:11.518324553Z [2024-02-23 02:35:11,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:35:12.130602347Z [2024-02-23 02:35:12,129: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f2be43e-e18c-43a3-87b7-ad05ce71f6ec] succeeded in 2.2107771360006154s: None 2024-02-23T02:36:00.775216755Z [2024-02-23 02:36:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ad2dafe-ec6e-4405-8d22-64d3bef46e1f] received 2024-02-23T02:36:00.778976365Z [2024-02-23 02:36:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d15f611c-f8da-4f7f-b082-766290c735ba] received 2024-02-23T02:36:00.793715320Z [2024-02-23 02:36:00,793: INFO/ForkPoolWorker-15] [8ad2dafe-ec6e-4405-8d22-64d3bef46e1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:36:00.798887618Z [2024-02-23 02:36:00,798: INFO/ForkPoolWorker-16] [d15f611c-f8da-4f7f-b082-766290c735ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:36:00.806580503Z [2024-02-23 02:36:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d695161-56fb-4240-8be0-65dc9d4ab624] received 2024-02-23T02:36:00.813913046Z [2024-02-23 02:36:00,813: INFO/ForkPoolWorker-1] [5d695161-56fb-4240-8be0-65dc9d4ab624] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:36:00.814321220Z [2024-02-23 02:36:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0bd723e-d443-4433-bd77-fa0ada7366d8] received 2024-02-23T02:36:00.824315132Z [2024-02-23 02:36:00,824: INFO/ForkPoolWorker-2] [a0bd723e-d443-4433-bd77-fa0ada7366d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:36:01.117706712Z [2024-02-23 02:36:01,114: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:36:01.139353155Z [2024-02-23 02:36:01,136: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:36:01.232085982Z [2024-02-23 02:36:01,228: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:36:01.256108400Z [2024-02-23 02:36:01,253: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:36:01.420438143Z [2024-02-23 02:36:01,419: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:36:01.427193757Z [2024-02-23 02:36:01,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:36:01.477340746Z [2024-02-23 02:36:01,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:36:01.479709095Z [2024-02-23 02:36:01,479: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:36:01.479918586Z [2024-02-23 02:36:01,479: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:36:01.480062674Z [2024-02-23 02:36:01,479: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:36:01.480326429Z [2024-02-23 02:36:01,480: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:36:01.485691850Z [2024-02-23 02:36:01,485: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:36:01.632919489Z [2024-02-23 02:36:01,632: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:36:02.157309301Z [2024-02-23 02:36:02,156: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5d695161-56fb-4240-8be0-65dc9d4ab624] succeeded in 1.3478213969992794s: None 2024-02-23T02:36:02.188764896Z [2024-02-23 02:36:02,188: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d15f611c-f8da-4f7f-b082-766290c735ba] succeeded in 1.4006313669997326s: None 2024-02-23T02:36:02.360126508Z [2024-02-23 02:36:02,359: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:36:02.363842449Z [2024-02-23 02:36:02,363: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:36:02.390740106Z [2024-02-23 02:36:02,390: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:36:02.392364093Z [2024-02-23 02:36:02,392: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:36:02.392424268Z [2024-02-23 02:36:02,392: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:36:02.392659618Z [2024-02-23 02:36:02,392: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:36:02.392723660Z [2024-02-23 02:36:02,392: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:36:02.393122159Z [2024-02-23 02:36:02,392: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:36:02.393204709Z [2024-02-23 02:36:02,393: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:36:02.499148432Z [2024-02-23 02:36:02,498: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:36:02.555496586Z [2024-02-23 02:36:02,555: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:36:02.559178041Z [2024-02-23 02:36:02,558: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:36:02.588016264Z [2024-02-23 02:36:02,587: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:36:02.590154277Z [2024-02-23 02:36:02,589: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:36:02.590177683Z [2024-02-23 02:36:02,589: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:36:02.590594526Z [2024-02-23 02:36:02,590: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:36:02.590890350Z [2024-02-23 02:36:02,590: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:36:02.591472637Z [2024-02-23 02:36:02,591: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:36:02.592187968Z [2024-02-23 02:36:02,591: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:36:02.673011312Z [2024-02-23 02:36:02,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:36:04.550541874Z [2024-02-23 02:36:04,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ad2dafe-ec6e-4405-8d22-64d3bef46e1f] succeeded in 3.7696760109993193s: None 2024-02-23T02:36:05.690485396Z [2024-02-23 02:36:05,690: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a0bd723e-d443-4433-bd77-fa0ada7366d8] succeeded in 4.874216075999357s: None 2024-02-23T02:37:01.167015597Z [2024-02-23 02:37:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94cffe08-105f-4924-8138-907da98f279a] received 2024-02-23T02:37:01.177189577Z [2024-02-23 02:37:01,176: INFO/ForkPoolWorker-15] [94cffe08-105f-4924-8138-907da98f279a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:37:01.178268550Z [2024-02-23 02:37:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[079f4500-1785-4c81-bd44-56cd2172dc31] received 2024-02-23T02:37:01.182883225Z [2024-02-23 02:37:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a3ba17b-576d-4158-ae87-894ae45b72ba] received 2024-02-23T02:37:01.193793248Z [2024-02-23 02:37:01,193: INFO/ForkPoolWorker-1] [7a3ba17b-576d-4158-ae87-894ae45b72ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:37:01.195455389Z [2024-02-23 02:37:01,195: INFO/ForkPoolWorker-16] [079f4500-1785-4c81-bd44-56cd2172dc31] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:37:01.469531842Z [2024-02-23 02:37:01,466: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:37:01.507449139Z [2024-02-23 02:37:01,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:37:01.563642351Z [2024-02-23 02:37:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:37:01.764742584Z [2024-02-23 02:37:01,764: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:37:01.768809914Z [2024-02-23 02:37:01,768: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:37:01.792586855Z [2024-02-23 02:37:01,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:37:01.793590228Z [2024-02-23 02:37:01,793: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:37:01.793694529Z [2024-02-23 02:37:01,793: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:37:01.794313900Z [2024-02-23 02:37:01,793: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:37:01.794941762Z [2024-02-23 02:37:01,794: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:37:01.921109852Z [2024-02-23 02:37:01,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:37:02.610178814Z [2024-02-23 02:37:02,609: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[079f4500-1785-4c81-bd44-56cd2172dc31] succeeded in 1.4292350920004537s: None 2024-02-23T02:37:02.638029453Z [2024-02-23 02:37:02,637: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:37:02.641553738Z [2024-02-23 02:37:02,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:37:02.661752684Z [2024-02-23 02:37:02,661: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:37:02.663317807Z [2024-02-23 02:37:02,663: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:37:02.663348762Z [2024-02-23 02:37:02,663: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:37:02.663560796Z [2024-02-23 02:37:02,663: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:37:02.663663031Z [2024-02-23 02:37:02,663: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:37:02.663926903Z [2024-02-23 02:37:02,663: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:37:02.664019552Z [2024-02-23 02:37:02,663: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:37:02.693844214Z [2024-02-23 02:37:02,693: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:37:02.697317762Z [2024-02-23 02:37:02,696: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:37:02.725342971Z [2024-02-23 02:37:02,725: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:37:02.727081705Z [2024-02-23 02:37:02,726: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:37:02.727313782Z [2024-02-23 02:37:02,727: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:37:02.727674727Z [2024-02-23 02:37:02,727: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:37:02.727850578Z [2024-02-23 02:37:02,727: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:37:02.728305764Z [2024-02-23 02:37:02,728: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:37:02.728497751Z [2024-02-23 02:37:02,728: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:37:02.760851964Z [2024-02-23 02:37:02,760: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:37:02.822027903Z [2024-02-23 02:37:02,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:37:05.558291662Z [2024-02-23 02:37:05,557: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a3ba17b-576d-4158-ae87-894ae45b72ba] succeeded in 4.373485217998677s: None 2024-02-23T02:37:06.332073580Z [2024-02-23 02:37:06,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94cffe08-105f-4924-8138-907da98f279a] succeeded in 5.162358227000368s: None 2024-02-23T02:37:38.885579970Z [2024-02-23 02:37:38,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[beaa7837-bbc5-4da6-9ea4-37da968d8352] received 2024-02-23T02:37:38.894273946Z [2024-02-23 02:37:38,893: INFO/ForkPoolWorker-15] [beaa7837-bbc5-4da6-9ea4-37da968d8352] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223023737_376744', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T02:37:39.187606487Z [2024-02-23 02:37:39,184: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T02:37:39.491844431Z [2024-02-23 02:37:39,491: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:37:40.104582746Z [2024-02-23 02:37:40,104: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[beaa7837-bbc5-4da6-9ea4-37da968d8352] succeeded in 1.2160235760002251s: None 2024-02-23T02:38:00.599363691Z [2024-02-23 02:38:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[863ec0c3-be86-49e2-8abb-f3ac824139d8] received 2024-02-23T02:38:00.606234755Z [2024-02-23 02:38:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bde04891-9d6f-4135-a02b-c6eb35ade572] received 2024-02-23T02:38:00.611072821Z [2024-02-23 02:38:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3db2ae82-ed11-4ec2-8c89-c3984bcef214] received 2024-02-23T02:38:00.623170366Z [2024-02-23 02:38:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[462343cb-dfd0-4952-a6e0-ca268ec74667] received 2024-02-23T02:38:00.623403127Z [2024-02-23 02:38:00,623: INFO/ForkPoolWorker-15] [863ec0c3-be86-49e2-8abb-f3ac824139d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:38:00.624576943Z [2024-02-23 02:38:00,624: INFO/ForkPoolWorker-1] [3db2ae82-ed11-4ec2-8c89-c3984bcef214] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:38:00.628028211Z [2024-02-23 02:38:00,627: INFO/ForkPoolWorker-16] [bde04891-9d6f-4135-a02b-c6eb35ade572] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:38:00.638148289Z [2024-02-23 02:38:00,637: INFO/ForkPoolWorker-2] [462343cb-dfd0-4952-a6e0-ca268ec74667] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:38:00.977002256Z [2024-02-23 02:38:00,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:38:00.994583834Z [2024-02-23 02:38:00,991: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:38:01.062229652Z [2024-02-23 02:38:01,058: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:38:01.252971527Z [2024-02-23 02:38:01,252: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:38:01.257126211Z [2024-02-23 02:38:01,256: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:38:01.286228368Z [2024-02-23 02:38:01,286: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:38:01.287649206Z [2024-02-23 02:38:01,287: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:38:01.287846252Z [2024-02-23 02:38:01,287: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:38:01.287990256Z [2024-02-23 02:38:01,287: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:38:01.288394763Z [2024-02-23 02:38:01,288: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:38:01.310507827Z [2024-02-23 02:38:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:38:01.430098623Z [2024-02-23 02:38:01,429: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:38:01.672191048Z [2024-02-23 02:38:01,671: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:38:02.008438899Z [2024-02-23 02:38:02,008: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bde04891-9d6f-4135-a02b-c6eb35ade572] succeeded in 1.3999449989987625s: None 2024-02-23T02:38:02.263566669Z [2024-02-23 02:38:02,263: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:38:02.267333486Z [2024-02-23 02:38:02,266: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:38:02.292670971Z [2024-02-23 02:38:02,292: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:38:02.294129098Z [2024-02-23 02:38:02,293: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:38:02.294261698Z [2024-02-23 02:38:02,294: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:38:02.294586891Z [2024-02-23 02:38:02,294: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:38:02.294769109Z [2024-02-23 02:38:02,294: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:38:02.295072375Z [2024-02-23 02:38:02,294: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:38:02.295197054Z [2024-02-23 02:38:02,295: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:38:02.331786624Z [2024-02-23 02:38:02,331: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3db2ae82-ed11-4ec2-8c89-c3984bcef214] succeeded in 1.7187487560004229s: None 2024-02-23T02:38:02.409267145Z [2024-02-23 02:38:02,409: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:38:02.513591421Z [2024-02-23 02:38:02,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:38:02.517904335Z [2024-02-23 02:38:02,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:38:02.539341340Z [2024-02-23 02:38:02,539: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:38:02.540960246Z [2024-02-23 02:38:02,540: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:38:02.541138887Z [2024-02-23 02:38:02,540: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:38:02.541361774Z [2024-02-23 02:38:02,541: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:38:02.541527370Z [2024-02-23 02:38:02,541: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:38:02.541896914Z [2024-02-23 02:38:02,541: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:38:02.542042372Z [2024-02-23 02:38:02,541: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:38:02.622177541Z [2024-02-23 02:38:02,621: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:38:04.893597224Z [2024-02-23 02:38:04,892: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[462343cb-dfd0-4952-a6e0-ca268ec74667] succeeded in 4.262665509000726s: None 2024-02-23T02:38:04.942352186Z [2024-02-23 02:38:04,941: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[863ec0c3-be86-49e2-8abb-f3ac824139d8] succeeded in 4.339953214001071s: None 2024-02-23T02:38:53.019757625Z [2024-02-23 02:38:53,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73ac7cc4-4402-40d7-8e48-3f1b94b9a5e9] received 2024-02-23T02:38:53.035949087Z [2024-02-23 02:38:53,035: INFO/ForkPoolWorker-15] [73ac7cc4-4402-40d7-8e48-3f1b94b9a5e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:38:53.379385084Z [2024-02-23 02:38:53,376: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:38:54.441649072Z [2024-02-23 02:38:54,441: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:38:54.444702915Z [2024-02-23 02:38:54,444: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:38:54.464903888Z [2024-02-23 02:38:54,464: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:38:54.466247579Z [2024-02-23 02:38:54,465: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:38:54.466281454Z [2024-02-23 02:38:54,466: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:38:54.466422873Z [2024-02-23 02:38:54,466: INFO/ForkPoolWorker-15] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:38:54.466622361Z [2024-02-23 02:38:54,466: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:38:54.466695173Z [2024-02-23 02:38:54,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:38:54.467030274Z [2024-02-23 02:38:54,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:38:54.467054268Z [2024-02-23 02:38:54,466: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:38:54.472031385Z [2024-02-23 02:38:54,471: INFO/ForkPoolWorker-15] Creating DAG vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:38:54.578349425Z [2024-02-23 02:38:54,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:38:56.201236629Z [2024-02-23 02:38:56,200: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73ac7cc4-4402-40d7-8e48-3f1b94b9a5e9] succeeded in 3.1771120700013853s: None 2024-02-23T02:39:01.050568053Z [2024-02-23 02:39:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a44b1b9-a9db-47a4-9b76-6dd92c510761] received 2024-02-23T02:39:01.053803812Z [2024-02-23 02:39:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1626bf0-d2ad-4a98-8fb6-1c3f933a058e] received 2024-02-23T02:39:01.059122986Z [2024-02-23 02:39:01,058: INFO/ForkPoolWorker-15] [4a44b1b9-a9db-47a4-9b76-6dd92c510761] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:39:01.066249784Z [2024-02-23 02:39:01,065: INFO/ForkPoolWorker-16] [a1626bf0-d2ad-4a98-8fb6-1c3f933a058e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:39:01.071237664Z [2024-02-23 02:39:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15bc1534-fc6d-4d11-a050-003b72fb3a99] received 2024-02-23T02:39:01.078851897Z [2024-02-23 02:39:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edc1d5e1-b2c6-41b6-8321-24ad198df0ca] received 2024-02-23T02:39:01.082411770Z [2024-02-23 02:39:01,082: INFO/ForkPoolWorker-1] [15bc1534-fc6d-4d11-a050-003b72fb3a99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:39:01.092251444Z [2024-02-23 02:39:01,091: INFO/ForkPoolWorker-2] [edc1d5e1-b2c6-41b6-8321-24ad198df0ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:39:01.426373799Z [2024-02-23 02:39:01,423: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:39:01.426442940Z [2024-02-23 02:39:01,423: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:39:01.449512398Z [2024-02-23 02:39:01,442: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:39:01.561298704Z [2024-02-23 02:39:01,558: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:39:01.783101214Z [2024-02-23 02:39:01,782: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:39:01.788689663Z [2024-02-23 02:39:01,788: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:01.818806649Z [2024-02-23 02:39:01,818: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:39:01.823750800Z [2024-02-23 02:39:01,823: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:39:01.824097246Z [2024-02-23 02:39:01,823: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:39:01.824360709Z [2024-02-23 02:39:01,824: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:39:01.824626042Z [2024-02-23 02:39:01,824: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:39:01.916001403Z [2024-02-23 02:39:01,915: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:02.653749921Z [2024-02-23 02:39:02,653: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[edc1d5e1-b2c6-41b6-8321-24ad198df0ca] succeeded in 1.5720971190003183s: None 2024-02-23T02:39:02.674043498Z [2024-02-23 02:39:02,673: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:39:02.677753528Z [2024-02-23 02:39:02,677: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:02.717517298Z [2024-02-23 02:39:02,717: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:39:02.719548472Z [2024-02-23 02:39:02,719: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:02.719613781Z [2024-02-23 02:39:02,719: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:02.719717817Z [2024-02-23 02:39:02,719: INFO/ForkPoolWorker-16] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:02.719899528Z [2024-02-23 02:39:02,719: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:02.719945495Z [2024-02-23 02:39:02,719: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:39:02.723935921Z [2024-02-23 02:39:02,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:39:02.723961899Z [2024-02-23 02:39:02,723: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:02.729911398Z [2024-02-23 02:39:02,729: INFO/ForkPoolWorker-16] Creating DAG vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:02.789332766Z [2024-02-23 02:39:02,788: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:39:02.793049426Z [2024-02-23 02:39:02,792: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:02.805910936Z [2024-02-23 02:39:02,805: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:02.852910283Z [2024-02-23 02:39:02,852: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:39:02.855127812Z [2024-02-23 02:39:02,854: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:02.855251647Z [2024-02-23 02:39:02,855: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:02.855399827Z [2024-02-23 02:39:02,855: INFO/ForkPoolWorker-1] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:02.855707578Z [2024-02-23 02:39:02,855: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:02.855859280Z [2024-02-23 02:39:02,855: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:39:02.856287592Z [2024-02-23 02:39:02,856: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:39:02.856454533Z [2024-02-23 02:39:02,856: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:02.866198104Z [2024-02-23 02:39:02,865: INFO/ForkPoolWorker-1] Creating DAG vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:02.886277927Z [2024-02-23 02:39:02,885: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:39:02.891426780Z [2024-02-23 02:39:02,890: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:02.932926365Z [2024-02-23 02:39:02,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:39:02.934274127Z [2024-02-23 02:39:02,934: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:02.943197158Z [2024-02-23 02:39:02,934: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:02.943282309Z [2024-02-23 02:39:02,943: INFO/ForkPoolWorker-15] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:02.944036494Z [2024-02-23 02:39:02,943: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:02.944090816Z [2024-02-23 02:39:02,943: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:39:02.944471496Z [2024-02-23 02:39:02,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:39:02.944939002Z [2024-02-23 02:39:02,944: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:02.955138966Z [2024-02-23 02:39:02,954: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:02.992415581Z [2024-02-23 02:39:02,992: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:03.098541229Z [2024-02-23 02:39:03,098: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:05.426155322Z [2024-02-23 02:39:05,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1626bf0-d2ad-4a98-8fb6-1c3f933a058e] succeeded in 4.369303800000125s: None 2024-02-23T02:39:05.937231277Z [2024-02-23 02:39:05,936: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15bc1534-fc6d-4d11-a050-003b72fb3a99] succeeded in 4.8636966129997745s: None 2024-02-23T02:39:06.766073805Z [2024-02-23 02:39:06,765: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a44b1b9-a9db-47a4-9b76-6dd92c510761] succeeded in 5.710744924001119s: None 2024-02-23T02:39:19.968207564Z [2024-02-23 02:39:19,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f34f5dac-1b88-4b19-b178-c8434af85b13] received 2024-02-23T02:39:19.989488423Z [2024-02-23 02:39:19,989: INFO/ForkPoolWorker-15] [f34f5dac-1b88-4b19-b178-c8434af85b13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:39:20.266090830Z [2024-02-23 02:39:20,263: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:39:21.335311308Z [2024-02-23 02:39:21,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:39:21.338670311Z [2024-02-23 02:39:21,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:21.353940740Z [2024-02-23 02:39:21,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:39:21.355174223Z [2024-02-23 02:39:21,354: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:21.355212283Z [2024-02-23 02:39:21,355: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:21.355270003Z [2024-02-23 02:39:21,355: INFO/ForkPoolWorker-15] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:21.355435696Z [2024-02-23 02:39:21,355: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:21.355475356Z [2024-02-23 02:39:21,355: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:39:21.355762913Z [2024-02-23 02:39:21,355: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:39:21.355858290Z [2024-02-23 02:39:21,355: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:21.360421045Z [2024-02-23 02:39:21,360: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:21.432865119Z [2024-02-23 02:39:21,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:23.279943535Z [2024-02-23 02:39:23,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc0cf18e-5abc-48c2-9249-d90ad5f2613e] received 2024-02-23T02:39:23.303390484Z [2024-02-23 02:39:23,303: INFO/ForkPoolWorker-16] [fc0cf18e-5abc-48c2-9249-d90ad5f2613e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:39:23.410149429Z [2024-02-23 02:39:23,409: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f34f5dac-1b88-4b19-b178-c8434af85b13] succeeded in 3.4378765849996853s: None 2024-02-23T02:39:23.647260986Z [2024-02-23 02:39:23,644: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:39:24.806951664Z [2024-02-23 02:39:24,806: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:39:24.810124759Z [2024-02-23 02:39:24,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:24.830905445Z [2024-02-23 02:39:24,830: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:39:24.832354276Z [2024-02-23 02:39:24,832: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:24.832511052Z [2024-02-23 02:39:24,832: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:24.832671965Z [2024-02-23 02:39:24,832: INFO/ForkPoolWorker-16] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:24.832876957Z [2024-02-23 02:39:24,832: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:24.833112078Z [2024-02-23 02:39:24,832: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:39:24.833573127Z [2024-02-23 02:39:24,833: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:39:24.833835918Z [2024-02-23 02:39:24,833: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:24.839357111Z [2024-02-23 02:39:24,839: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:24.952396024Z [2024-02-23 02:39:24,951: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:25.611570535Z [2024-02-23 02:39:25,610: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc0cf18e-5abc-48c2-9249-d90ad5f2613e] succeeded in 2.327291266999964s: None 2024-02-23T02:39:26.509678009Z [2024-02-23 02:39:26,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f88d5172-dc6c-4177-a5e8-801295b72f16] received 2024-02-23T02:39:26.518523798Z [2024-02-23 02:39:26,518: INFO/ForkPoolWorker-15] [f88d5172-dc6c-4177-a5e8-801295b72f16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'split_metrics', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:39:26.815819058Z [2024-02-23 02:39:26,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:39:27.851750882Z [2024-02-23 02:39:27,851: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:39:27.855795932Z [2024-02-23 02:39:27,855: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:27.918642994Z [2024-02-23 02:39:27,905: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:39:27.918678074Z [2024-02-23 02:39:27,907: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:27.918682434Z [2024-02-23 02:39:27,907: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:27.918686164Z [2024-02-23 02:39:27,907: INFO/ForkPoolWorker-15] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:27.918695275Z [2024-02-23 02:39:27,907: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:27.918699647Z [2024-02-23 02:39:27,908: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:39:27.918703127Z [2024-02-23 02:39:27,908: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:39:27.918706697Z [2024-02-23 02:39:27,908: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:27.920257410Z [2024-02-23 02:39:27,919: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:28.040100886Z [2024-02-23 02:39:28,039: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:28.712779042Z [2024-02-23 02:39:28,712: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f88d5172-dc6c-4177-a5e8-801295b72f16] succeeded in 2.20108797300054s: None 2024-02-23T02:39:28.909483481Z [2024-02-23 02:39:28,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1989bda-becb-45f6-b010-c909826aa256] received 2024-02-23T02:39:28.919672371Z [2024-02-23 02:39:28,919: INFO/ForkPoolWorker-15] [b1989bda-becb-45f6-b010-c909826aa256] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'collect_metrics', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:39:29.267535812Z [2024-02-23 02:39:29,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:39:30.294139919Z [2024-02-23 02:39:30,293: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:39:30.297038817Z [2024-02-23 02:39:30,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:30.319209662Z [2024-02-23 02:39:30,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:39:30.321025563Z [2024-02-23 02:39:30,320: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:30.321049541Z [2024-02-23 02:39:30,320: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:30.321108727Z [2024-02-23 02:39:30,320: INFO/ForkPoolWorker-15] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:30.321327723Z [2024-02-23 02:39:30,321: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:30.321341480Z [2024-02-23 02:39:30,321: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:39:30.322029939Z [2024-02-23 02:39:30,321: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:39:30.322056794Z [2024-02-23 02:39:30,321: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:30.331543906Z [2024-02-23 02:39:30,331: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:30.425683418Z [2024-02-23 02:39:30,425: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:31.033915927Z [2024-02-23 02:39:31,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1989bda-becb-45f6-b010-c909826aa256] succeeded in 2.1227174919986282s: None 2024-02-23T02:39:31.223695568Z [2024-02-23 02:39:31,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa820022-0df9-4929-a6df-f2762770eceb] received 2024-02-23T02:39:31.239102602Z [2024-02-23 02:39:31,238: INFO/ForkPoolWorker-15] [aa820022-0df9-4929-a6df-f2762770eceb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'send_prometheus', 'scheduled__2024-02-23T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:39:31.523347204Z [2024-02-23 02:39:31,520: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:39:32.568240249Z [2024-02-23 02:39:32,567: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:39:32.571096231Z [2024-02-23 02:39:32,570: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:39:32.594044566Z [2024-02-23 02:39:32,593: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:39:32.595396146Z [2024-02-23 02:39:32,595: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:39:32.595475919Z [2024-02-23 02:39:32,595: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:39:32.595521346Z [2024-02-23 02:39:32,595: INFO/ForkPoolWorker-15] Read VIM 0efc7a49-b1e5-4c55-8f21-56fe8e1864cb (basic01_005563) 2024-02-23T02:39:32.595736581Z [2024-02-23 02:39:32,595: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'name': 'basic01_005563', 'vim_type': 'openstack'}] 2024-02-23T02:39:32.595897137Z [2024-02-23 02:39:32,595: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:39:32.596282469Z [2024-02-23 02:39:32,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:39:32.596428015Z [2024-02-23 02:39:32,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:39:32.601511704Z [2024-02-23 02:39:32,601: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb 2024-02-23T02:39:32.686262275Z [2024-02-23 02:39:32,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:33.366071393Z [2024-02-23 02:39:33,365: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa820022-0df9-4929-a6df-f2762770eceb] succeeded in 2.140680312000768s: None 2024-02-23T02:39:38.525709406Z [2024-02-23 02:39:38,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03f1f026-c866-4b2e-bdaa-a64031e15eb0] received 2024-02-23T02:39:38.537544100Z [2024-02-23 02:39:38,536: INFO/ForkPoolWorker-15] [03f1f026-c866-4b2e-bdaa-a64031e15eb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223023937_520531', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T02:39:38.926794297Z [2024-02-23 02:39:38,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T02:39:39.245490620Z [2024-02-23 02:39:39,244: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:39:39.805088317Z [2024-02-23 02:39:39,804: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03f1f026-c866-4b2e-bdaa-a64031e15eb0] succeeded in 1.2762762279999151s: None 2024-02-23T02:40:00.730397162Z [2024-02-23 02:40:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[903a1e63-2110-438e-b4c6-2dbfab024e17] received 2024-02-23T02:40:00.741910002Z [2024-02-23 02:40:00,741: INFO/ForkPoolWorker-15] [903a1e63-2110-438e-b4c6-2dbfab024e17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:40:00.748526651Z [2024-02-23 02:40:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4de80a1c-c646-45a7-ab63-3d14fb7b2eaf] received 2024-02-23T02:40:00.759607433Z [2024-02-23 02:40:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[addcb8bd-74d2-4e46-8b2d-b30402bedd46] received 2024-02-23T02:40:00.767624588Z [2024-02-23 02:40:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b42aab4-48bc-43e4-b8df-90720d62678e] received 2024-02-23T02:40:00.776663771Z [2024-02-23 02:40:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6da7843b-f1c4-4d61-b2ab-4eed8134f9c9] received 2024-02-23T02:40:00.780711817Z [2024-02-23 02:40:00,780: INFO/ForkPoolWorker-16] [4de80a1c-c646-45a7-ab63-3d14fb7b2eaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:40:00.786947080Z [2024-02-23 02:40:00,786: INFO/ForkPoolWorker-2] [5b42aab4-48bc-43e4-b8df-90720d62678e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:40:00.788882252Z [2024-02-23 02:40:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54f259c0-7e06-4e44-8a95-4d2d1f612614] received 2024-02-23T02:40:00.789675155Z [2024-02-23 02:40:00,789: INFO/ForkPoolWorker-1] [addcb8bd-74d2-4e46-8b2d-b30402bedd46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:40:00.796774381Z [2024-02-23 02:40:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62374456-d9a5-49b4-ad93-95e8d62eac46] received 2024-02-23T02:40:00.799666490Z [2024-02-23 02:40:00,799: INFO/ForkPoolWorker-3] [6da7843b-f1c4-4d61-b2ab-4eed8134f9c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:40:00.804266954Z [2024-02-23 02:40:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35328e20-e882-4680-b710-32a322dd449e] received 2024-02-23T02:40:00.804551862Z [2024-02-23 02:40:00,803: INFO/ForkPoolWorker-4] [54f259c0-7e06-4e44-8a95-4d2d1f612614] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:40:00.816650920Z [2024-02-23 02:40:00,816: INFO/ForkPoolWorker-5] [62374456-d9a5-49b4-ad93-95e8d62eac46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:40:00.892676569Z [2024-02-23 02:40:00,892: INFO/ForkPoolWorker-6] [35328e20-e882-4680-b710-32a322dd449e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:40:01.299200142Z [2024-02-23 02:40:01,295: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:01.355804556Z [2024-02-23 02:40:01,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:01.511439951Z [2024-02-23 02:40:01,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:01.697132392Z [2024-02-23 02:40:01,693: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:40:01.707184234Z [2024-02-23 02:40:01,699: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:40:01.811805287Z [2024-02-23 02:40:01,808: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:01.938817968Z [2024-02-23 02:40:01,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:02.216020820Z [2024-02-23 02:40:02,215: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:02.285827651Z [2024-02-23 02:40:02,270: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:03.075652785Z [2024-02-23 02:40:03,075: INFO/ForkPoolWorker-6] Getting SDNC list 2024-02-23T02:40:03.144092005Z [2024-02-23 02:40:03,124: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:03.245678146Z [2024-02-23 02:40:03,245: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-02-23T02:40:03.249461746Z [2024-02-23 02:40:03,249: INFO/ForkPoolWorker-6] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:40:03.249907881Z [2024-02-23 02:40:03,249: INFO/ForkPoolWorker-6] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:40:03.250301833Z [2024-02-23 02:40:03,250: INFO/ForkPoolWorker-6] Getting SDNC list OK 2024-02-23T02:40:03.250783589Z [2024-02-23 02:40:03,250: INFO/ForkPoolWorker-6] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:40:03.412507306Z [2024-02-23 02:40:03,412: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[54f259c0-7e06-4e44-8a95-4d2d1f612614] succeeded in 2.6211726469991845s: None 2024-02-23T02:40:03.537284759Z [2024-02-23 02:40:03,536: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:03.987460606Z [2024-02-23 02:40:03,987: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T02:40:03.991292182Z [2024-02-23 02:40:03,990: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:04.035529964Z [2024-02-23 02:40:04,035: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:40:04.042431107Z [2024-02-23 02:40:04,042: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:04.042455749Z [2024-02-23 02:40:04,042: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:04.042519657Z [2024-02-23 02:40:04,042: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:04.042525173Z [2024-02-23 02:40:04,042: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T02:40:04.042774981Z [2024-02-23 02:40:04,042: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:04.042785008Z [2024-02-23 02:40:04,042: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:04.051816080Z [2024-02-23 02:40:04,051: WARNING/ForkPoolWorker-3] Dag 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:04.052582173Z [2024-02-23 02:40:04,051: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:04.053493872Z [2024-02-23 02:40:04,053: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T02:40:04.056570151Z [2024-02-23 02:40:04,056: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:04.180288592Z [2024-02-23 02:40:04,179: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:40:04.184244880Z [2024-02-23 02:40:04,183: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:04.184319082Z [2024-02-23 02:40:04,184: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:04.184635078Z [2024-02-23 02:40:04,184: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:04.184690477Z [2024-02-23 02:40:04,184: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T02:40:04.185125503Z [2024-02-23 02:40:04,184: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:04.185147087Z [2024-02-23 02:40:04,185: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:04.190785444Z [2024-02-23 02:40:04,189: ERROR/ForkPoolWorker-3] [6da7843b-f1c4-4d61-b2ab-4eed8134f9c9] Failed to execute task Dag 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:40:04.190890246Z Traceback (most recent call last): 2024-02-23T02:40:04.190900028Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:40:04.190906520Z args.func(args) 2024-02-23T02:40:04.190913057Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:40:04.190952604Z return func(*args, **kwargs) 2024-02-23T02:40:04.190958377Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:40:04.190963543Z return f(*args, **kwargs) 2024-02-23T02:40:04.190968188Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:40:04.190972875Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:40:04.190977646Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:40:04.190982235Z raise AirflowException( 2024-02-23T02:40:04.190993754Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:40:04.306011133Z [2024-02-23 02:40:04,305: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6da7843b-f1c4-4d61-b2ab-4eed8134f9c9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6da7843b-f1c4-4d61-b2ab-4eed8134f9c9') 2024-02-23T02:40:04.306036846Z Traceback (most recent call last): 2024-02-23T02:40:04.306041534Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:40:04.306061682Z R = retval = fun(*args, **kwargs) 2024-02-23T02:40:04.306065111Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:40:04.306068964Z return self.run(*args, **kwargs) 2024-02-23T02:40:04.306073202Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:40:04.306077262Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:40:04.306080617Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:40:04.306084608Z raise AirflowException(msg) 2024-02-23T02:40:04.306088706Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6da7843b-f1c4-4d61-b2ab-4eed8134f9c9 2024-02-23T02:40:04.615789465Z [2024-02-23 02:40:04,615: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:40:04.622959174Z [2024-02-23 02:40:04,622: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:04.675511809Z [2024-02-23 02:40:04,675: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:40:04.681048905Z [2024-02-23 02:40:04,680: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:04.681111835Z [2024-02-23 02:40:04,681: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:04.681265949Z [2024-02-23 02:40:04,681: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:04.681361041Z [2024-02-23 02:40:04,681: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:40:04.681638527Z [2024-02-23 02:40:04,681: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:40:04.682501308Z [2024-02-23 02:40:04,682: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:04.834268336Z [2024-02-23 02:40:04,833: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:04.854438502Z [2024-02-23 02:40:04,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:04.951429928Z [2024-02-23 02:40:04,951: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:04.953269545Z [2024-02-23 02:40:04,953: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:04.953529404Z [2024-02-23 02:40:04,953: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:04.953745749Z [2024-02-23 02:40:04,953: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:04.953882252Z [2024-02-23 02:40:04,953: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:04.954227938Z [2024-02-23 02:40:04,954: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:40:04.954622448Z [2024-02-23 02:40:04,954: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:04.982251929Z [2024-02-23 02:40:04,982: WARNING/ForkPoolWorker-15] Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:04.999164525Z [2024-02-23 02:40:04,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:05.010469179Z [2024-02-23 02:40:05,010: INFO/ForkPoolWorker-5] Getting VIM list 2024-02-23T02:40:05.010900570Z [2024-02-23 02:40:05,004: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:05.029000293Z [2024-02-23 02:40:05,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:05.044708481Z [2024-02-23 02:40:05,044: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:05.063011237Z [2024-02-23 02:40:05,062: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:05.119410998Z [2024-02-23 02:40:05,119: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:05.125372909Z [2024-02-23 02:40:05,125: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:05.130208525Z [2024-02-23 02:40:05,129: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:05.130744227Z [2024-02-23 02:40:05,130: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:05.130935388Z [2024-02-23 02:40:05,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:05.131364680Z [2024-02-23 02:40:05,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:40:05.131529444Z [2024-02-23 02:40:05,131: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:05.149809195Z [2024-02-23 02:40:05,134: ERROR/ForkPoolWorker-15] [903a1e63-2110-438e-b4c6-2dbfab024e17] Failed to execute task Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:40:05.149834626Z Traceback (most recent call last): 2024-02-23T02:40:05.149839065Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:40:05.149842983Z args.func(args) 2024-02-23T02:40:05.149846844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:40:05.149850590Z return func(*args, **kwargs) 2024-02-23T02:40:05.149853796Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:40:05.149857005Z return f(*args, **kwargs) 2024-02-23T02:40:05.149873718Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:40:05.149877174Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:40:05.149880275Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:40:05.149883317Z raise AirflowException( 2024-02-23T02:40:05.149887130Z airflow.exceptions.AirflowException: Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:40:05.178638548Z [2024-02-23 02:40:05,178: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-02-23T02:40:05.188045293Z [2024-02-23 02:40:05,187: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[903a1e63-2110-438e-b4c6-2dbfab024e17] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 903a1e63-2110-438e-b4c6-2dbfab024e17') 2024-02-23T02:40:05.188064439Z Traceback (most recent call last): 2024-02-23T02:40:05.188068755Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:40:05.188072047Z R = retval = fun(*args, **kwargs) 2024-02-23T02:40:05.188075200Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:40:05.188078598Z return self.run(*args, **kwargs) 2024-02-23T02:40:05.188082495Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:40:05.188086124Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:40:05.188089615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:40:05.188093398Z raise AirflowException(msg) 2024-02-23T02:40:05.188097235Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 903a1e63-2110-438e-b4c6-2dbfab024e17 2024-02-23T02:40:05.189379764Z [2024-02-23 02:40:05,189: INFO/ForkPoolWorker-5] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:05.189458224Z [2024-02-23 02:40:05,189: INFO/ForkPoolWorker-5] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:05.189797683Z [2024-02-23 02:40:05,189: INFO/ForkPoolWorker-5] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:05.189978027Z [2024-02-23 02:40:05,189: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-02-23T02:40:05.190349517Z [2024-02-23 02:40:05,190: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:40:05.190400837Z [2024-02-23 02:40:05,190: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:05.204409107Z [2024-02-23 02:40:05,204: WARNING/ForkPoolWorker-5] Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:05.206038984Z [2024-02-23 02:40:05,204: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:05.207542861Z [2024-02-23 02:40:05,207: INFO/ForkPoolWorker-5] Getting VIM list 2024-02-23T02:40:05.210770479Z [2024-02-23 02:40:05,210: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:05.298658904Z [2024-02-23 02:40:05,297: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-02-23T02:40:05.302591640Z [2024-02-23 02:40:05,302: INFO/ForkPoolWorker-5] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:05.307780275Z [2024-02-23 02:40:05,307: INFO/ForkPoolWorker-5] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:05.308170121Z [2024-02-23 02:40:05,307: INFO/ForkPoolWorker-5] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:05.308361228Z [2024-02-23 02:40:05,308: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-02-23T02:40:05.308856531Z [2024-02-23 02:40:05,308: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:40:05.309052008Z [2024-02-23 02:40:05,308: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:05.319323461Z [2024-02-23 02:40:05,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:40:05.322721321Z [2024-02-23 02:40:05,322: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:05.324505323Z [2024-02-23 02:40:05,322: ERROR/ForkPoolWorker-5] [62374456-d9a5-49b4-ad93-95e8d62eac46] Failed to execute task Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:40:05.324528459Z Traceback (most recent call last): 2024-02-23T02:40:05.324534638Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:40:05.324540776Z args.func(args) 2024-02-23T02:40:05.324546055Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:40:05.324551406Z return func(*args, **kwargs) 2024-02-23T02:40:05.324556262Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:40:05.324561438Z return f(*args, **kwargs) 2024-02-23T02:40:05.324580138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:40:05.324585346Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:40:05.324590046Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:40:05.324594957Z raise AirflowException( 2024-02-23T02:40:05.324600389Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:40:05.344805737Z [2024-02-23 02:40:05,344: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[35328e20-e882-4680-b710-32a322dd449e] succeeded in 4.534334100999331s: None 2024-02-23T02:40:05.369025135Z [2024-02-23 02:40:05,368: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:40:05.372508659Z [2024-02-23 02:40:05,372: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:05.372649342Z [2024-02-23 02:40:05,372: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:05.372677023Z [2024-02-23 02:40:05,372: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:05.372775239Z [2024-02-23 02:40:05,372: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:40:05.372937322Z [2024-02-23 02:40:05,372: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:40:05.373028694Z [2024-02-23 02:40:05,372: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:05.417750558Z [2024-02-23 02:40:05,415: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[62374456-d9a5-49b4-ad93-95e8d62eac46] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 62374456-d9a5-49b4-ad93-95e8d62eac46') 2024-02-23T02:40:05.417786413Z Traceback (most recent call last): 2024-02-23T02:40:05.417794274Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:40:05.417800297Z R = retval = fun(*args, **kwargs) 2024-02-23T02:40:05.417805773Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:40:05.417811454Z return self.run(*args, **kwargs) 2024-02-23T02:40:05.417822484Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:40:05.417828701Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:40:05.417834434Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:40:05.417845150Z raise AirflowException(msg) 2024-02-23T02:40:05.417851648Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 62374456-d9a5-49b4-ad93-95e8d62eac46 2024-02-23T02:40:05.529750938Z [2024-02-23 02:40:05,529: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:05.606321356Z [2024-02-23 02:40:05,605: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:40:05.609890961Z [2024-02-23 02:40:05,609: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:05.629230478Z [2024-02-23 02:40:05,629: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:40:05.630471118Z [2024-02-23 02:40:05,630: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:05.630592928Z [2024-02-23 02:40:05,630: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:05.630802923Z [2024-02-23 02:40:05,630: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:05.630924107Z [2024-02-23 02:40:05,630: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:40:05.631416051Z [2024-02-23 02:40:05,631: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:05.631500949Z [2024-02-23 02:40:05,631: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:05.712344888Z [2024-02-23 02:40:05,712: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:06.327333248Z [2024-02-23 02:40:06,326: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5b42aab4-48bc-43e4-b8df-90720d62678e] succeeded in 5.557772681999268s: None 2024-02-23T02:40:06.417072722Z [2024-02-23 02:40:06,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b74694f-1d5e-4e1d-84a1-31bc6dda0981] received 2024-02-23T02:40:06.443602807Z [2024-02-23 02:40:06,442: INFO/ForkPoolWorker-15] [1b74694f-1d5e-4e1d-84a1-31bc6dda0981] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:40:06.739695472Z [2024-02-23 02:40:06,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:07.946409877Z [2024-02-23 02:40:07,945: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:07.951054166Z [2024-02-23 02:40:07,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:07.989746488Z [2024-02-23 02:40:07,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:07.990896929Z [2024-02-23 02:40:07,990: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:07.990953425Z [2024-02-23 02:40:07,990: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:07.991077288Z [2024-02-23 02:40:07,990: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:07.991124386Z [2024-02-23 02:40:07,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:07.991317615Z [2024-02-23 02:40:07,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:07.991377935Z [2024-02-23 02:40:07,991: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:08.118922958Z [2024-02-23 02:40:08,118: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[addcb8bd-74d2-4e46-8b2d-b30402bedd46] succeeded in 7.338501756999904s: None 2024-02-23T02:40:08.171546092Z [2024-02-23 02:40:08,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:08.575972785Z [2024-02-23 02:40:08,575: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4de80a1c-c646-45a7-ab63-3d14fb7b2eaf] succeeded in 7.824000431000968s: None 2024-02-23T02:40:08.870048038Z [2024-02-23 02:40:08,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53c11559-efce-492a-9283-a061f5e293e6] received 2024-02-23T02:40:08.876019284Z [2024-02-23 02:40:08,875: INFO/ForkPoolWorker-16] [53c11559-efce-492a-9283-a061f5e293e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:40:08.962542644Z [2024-02-23 02:40:08,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b74694f-1d5e-4e1d-84a1-31bc6dda0981] succeeded in 2.5388188870001613s: None 2024-02-23T02:40:09.182459006Z [2024-02-23 02:40:09,179: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:10.316364153Z [2024-02-23 02:40:10,315: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:40:10.319560802Z [2024-02-23 02:40:10,319: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:10.347242765Z [2024-02-23 02:40:10,346: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:40:10.349487060Z [2024-02-23 02:40:10,349: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:10.349564376Z [2024-02-23 02:40:10,349: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:10.349583851Z [2024-02-23 02:40:10,349: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:10.349591328Z [2024-02-23 02:40:10,349: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:40:10.349829257Z [2024-02-23 02:40:10,349: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:10.349838790Z [2024-02-23 02:40:10,349: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:10.428020540Z [2024-02-23 02:40:10,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:10.995481855Z [2024-02-23 02:40:10,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53c11559-efce-492a-9283-a061f5e293e6] succeeded in 2.123609276000934s: None 2024-02-23T02:40:11.396460723Z [2024-02-23 02:40:11,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51a58bc6-6084-446a-a70a-5b52bf4d6a07] received 2024-02-23T02:40:11.404661160Z [2024-02-23 02:40:11,404: INFO/ForkPoolWorker-15] [51a58bc6-6084-446a-a70a-5b52bf4d6a07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:40:11.668643837Z [2024-02-23 02:40:11,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:12.730107433Z [2024-02-23 02:40:12,729: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:12.733308397Z [2024-02-23 02:40:12,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:12.755819929Z [2024-02-23 02:40:12,755: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:12.757132599Z [2024-02-23 02:40:12,756: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:12.757172422Z [2024-02-23 02:40:12,757: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:12.757359221Z [2024-02-23 02:40:12,757: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:12.757375739Z [2024-02-23 02:40:12,757: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:12.757960652Z [2024-02-23 02:40:12,757: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:12.758023664Z [2024-02-23 02:40:12,757: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:12.840540485Z [2024-02-23 02:40:12,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:40:13.449458255Z [2024-02-23 02:40:13,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51a58bc6-6084-446a-a70a-5b52bf4d6a07] succeeded in 2.0511242659995332s: None 2024-02-23T02:40:15.052098799Z [2024-02-23 02:40:15,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8c995f0-d7c0-411d-af8c-26fcb24862c3] received 2024-02-23T02:40:15.058749599Z [2024-02-23 02:40:15,058: INFO/ForkPoolWorker-15] [f8c995f0-d7c0-411d-af8c-26fcb24862c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:40:15.329782766Z [2024-02-23 02:40:15,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:16.495219114Z [2024-02-23 02:40:16,494: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:16.498173903Z [2024-02-23 02:40:16,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:16.517641694Z [2024-02-23 02:40:16,517: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:16.519421204Z [2024-02-23 02:40:16,519: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:16.519453726Z [2024-02-23 02:40:16,519: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:16.519649897Z [2024-02-23 02:40:16,519: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:16.519734617Z [2024-02-23 02:40:16,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:16.519975581Z [2024-02-23 02:40:16,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:16.520187578Z [2024-02-23 02:40:16,520: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:16.528932819Z [2024-02-23 02:40:16,528: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:16.529987431Z [2024-02-23 02:40:16,529: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:40:16.531149454Z [2024-02-23 02:40:16,530: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:16.534977909Z [2024-02-23 02:40:16,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:16.550377233Z [2024-02-23 02:40:16,550: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:16.552338259Z [2024-02-23 02:40:16,551: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:16.552356878Z [2024-02-23 02:40:16,551: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:16.552362849Z [2024-02-23 02:40:16,551: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:16.552368055Z [2024-02-23 02:40:16,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:16.552372391Z [2024-02-23 02:40:16,552: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:40:16.552376684Z [2024-02-23 02:40:16,552: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:16.560697605Z [2024-02-23 02:40:16,559: ERROR/ForkPoolWorker-15] [f8c995f0-d7c0-411d-af8c-26fcb24862c3] Failed to execute task Dag 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:40:16.560735956Z Traceback (most recent call last): 2024-02-23T02:40:16.560745755Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:40:16.560755843Z args.func(args) 2024-02-23T02:40:16.560765052Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:40:16.560774678Z return func(*args, **kwargs) 2024-02-23T02:40:16.560782587Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:40:16.560790669Z return f(*args, **kwargs) 2024-02-23T02:40:16.560798520Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:40:16.560807067Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:40:16.560815021Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:40:16.560822914Z raise AirflowException( 2024-02-23T02:40:16.560831618Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:40:16.603025814Z [2024-02-23 02:40:16,602: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8c995f0-d7c0-411d-af8c-26fcb24862c3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8c995f0-d7c0-411d-af8c-26fcb24862c3') 2024-02-23T02:40:16.603049672Z Traceback (most recent call last): 2024-02-23T02:40:16.603055173Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:40:16.603077372Z R = retval = fun(*args, **kwargs) 2024-02-23T02:40:16.603081772Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:40:16.603085893Z return self.run(*args, **kwargs) 2024-02-23T02:40:16.603090849Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:40:16.603096888Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:40:16.603101053Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:40:16.603105887Z raise AirflowException(msg) 2024-02-23T02:40:16.603110802Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8c995f0-d7c0-411d-af8c-26fcb24862c3 2024-02-23T02:40:17.690284052Z [2024-02-23 02:40:17,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f5494ab-0949-4d4f-a4e4-d1559ab820f7] received 2024-02-23T02:40:17.696119746Z [2024-02-23 02:40:17,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0eaa3b3-785c-4b41-98f8-4554396f565b] received 2024-02-23T02:40:17.703586900Z [2024-02-23 02:40:17,703: INFO/ForkPoolWorker-16] [a0eaa3b3-785c-4b41-98f8-4554396f565b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:40:17.705533674Z [2024-02-23 02:40:17,705: INFO/ForkPoolWorker-15] [2f5494ab-0949-4d4f-a4e4-d1559ab820f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:40:18.020120737Z [2024-02-23 02:40:18,017: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:18.064178002Z [2024-02-23 02:40:18,060: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:19.107751084Z [2024-02-23 02:40:19,107: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:19.110907924Z [2024-02-23 02:40:19,110: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:19.128573800Z [2024-02-23 02:40:19,128: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:19.129676847Z [2024-02-23 02:40:19,129: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:19.129684430Z [2024-02-23 02:40:19,129: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:19.129895253Z [2024-02-23 02:40:19,129: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:19.129936715Z [2024-02-23 02:40:19,129: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:19.130159316Z [2024-02-23 02:40:19,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:40:19.130222751Z [2024-02-23 02:40:19,130: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:19.135981291Z [2024-02-23 02:40:19,135: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:19.136577377Z [2024-02-23 02:40:19,136: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:40:19.137327674Z [2024-02-23 02:40:19,137: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:40:19.139818785Z [2024-02-23 02:40:19,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:19.157100180Z [2024-02-23 02:40:19,156: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:40:19.158280271Z [2024-02-23 02:40:19,158: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:19.158342368Z [2024-02-23 02:40:19,158: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:19.158486054Z [2024-02-23 02:40:19,158: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:19.158654705Z [2024-02-23 02:40:19,158: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:40:19.159359510Z [2024-02-23 02:40:19,159: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:40:19.159824192Z [2024-02-23 02:40:19,159: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:19.163746473Z [2024-02-23 02:40:19,162: ERROR/ForkPoolWorker-15] [2f5494ab-0949-4d4f-a4e4-d1559ab820f7] Failed to execute task Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:40:19.163759654Z Traceback (most recent call last): 2024-02-23T02:40:19.163763576Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:40:19.163767432Z args.func(args) 2024-02-23T02:40:19.163771407Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:40:19.163775748Z return func(*args, **kwargs) 2024-02-23T02:40:19.163779116Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:40:19.163782415Z return f(*args, **kwargs) 2024-02-23T02:40:19.163786014Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:40:19.163789295Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:40:19.163792662Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:40:19.163795912Z raise AirflowException( 2024-02-23T02:40:19.163800386Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:40:19.198610703Z [2024-02-23 02:40:19,197: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f5494ab-0949-4d4f-a4e4-d1559ab820f7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2f5494ab-0949-4d4f-a4e4-d1559ab820f7') 2024-02-23T02:40:19.198647183Z Traceback (most recent call last): 2024-02-23T02:40:19.198652800Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:40:19.198657218Z R = retval = fun(*args, **kwargs) 2024-02-23T02:40:19.198665890Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:40:19.198670528Z return self.run(*args, **kwargs) 2024-02-23T02:40:19.198675853Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:40:19.198681044Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:40:19.198685333Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:40:19.198690295Z raise AirflowException(msg) 2024-02-23T02:40:19.198695412Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2f5494ab-0949-4d4f-a4e4-d1559ab820f7 2024-02-23T02:40:19.222153089Z [2024-02-23 02:40:19,221: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:40:19.225923596Z [2024-02-23 02:40:19,225: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:19.245670395Z [2024-02-23 02:40:19,245: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:40:19.247658519Z [2024-02-23 02:40:19,247: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:19.247886800Z [2024-02-23 02:40:19,247: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:19.248137942Z [2024-02-23 02:40:19,247: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:19.248427075Z [2024-02-23 02:40:19,248: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:40:19.249050951Z [2024-02-23 02:40:19,248: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:40:19.249393249Z [2024-02-23 02:40:19,249: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:19.257141864Z [2024-02-23 02:40:19,256: WARNING/ForkPoolWorker-16] Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:19.258225419Z [2024-02-23 02:40:19,257: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:40:19.259208687Z [2024-02-23 02:40:19,259: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:40:19.262562606Z [2024-02-23 02:40:19,262: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:40:19.277117185Z [2024-02-23 02:40:19,276: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:40:19.278549810Z [2024-02-23 02:40:19,278: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:40:19.278767713Z [2024-02-23 02:40:19,278: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:40:19.279012469Z [2024-02-23 02:40:19,278: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:40:19.279216709Z [2024-02-23 02:40:19,279: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:40:19.279733121Z [2024-02-23 02:40:19,279: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:40:19.279895891Z [2024-02-23 02:40:19,279: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:40:19.283257688Z [2024-02-23 02:40:19,282: ERROR/ForkPoolWorker-16] [a0eaa3b3-785c-4b41-98f8-4554396f565b] Failed to execute task Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:40:19.283269966Z Traceback (most recent call last): 2024-02-23T02:40:19.283274590Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:40:19.283278234Z args.func(args) 2024-02-23T02:40:19.283281719Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:40:19.283285754Z return func(*args, **kwargs) 2024-02-23T02:40:19.283288802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:40:19.283291789Z return f(*args, **kwargs) 2024-02-23T02:40:19.283294885Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:40:19.283297938Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:40:19.283314894Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:40:19.283318569Z raise AirflowException( 2024-02-23T02:40:19.283322409Z airflow.exceptions.AirflowException: Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:40:19.326925870Z [2024-02-23 02:40:19,325: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0eaa3b3-785c-4b41-98f8-4554396f565b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a0eaa3b3-785c-4b41-98f8-4554396f565b') 2024-02-23T02:40:19.326963876Z Traceback (most recent call last): 2024-02-23T02:40:19.326979040Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:40:19.326988327Z R = retval = fun(*args, **kwargs) 2024-02-23T02:40:19.326997710Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:40:19.327006580Z return self.run(*args, **kwargs) 2024-02-23T02:40:19.327015874Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:40:19.327025715Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:40:19.327034596Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:40:19.327044243Z raise AirflowException(msg) 2024-02-23T02:40:19.327054043Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a0eaa3b3-785c-4b41-98f8-4554396f565b 2024-02-23T02:41:00.512098339Z [2024-02-23 02:41:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1a40f24-f233-4d72-9317-bd038bec24ba] received 2024-02-23T02:41:00.516436673Z [2024-02-23 02:41:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1be062bd-ea66-4b40-8def-23dfb37c219a] received 2024-02-23T02:41:00.521228182Z [2024-02-23 02:41:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0705e405-0882-4a5b-b17e-b9a3dafdd8e4] received 2024-02-23T02:41:00.521883295Z [2024-02-23 02:41:00,521: INFO/ForkPoolWorker-15] [c1a40f24-f233-4d72-9317-bd038bec24ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:41:00.527475848Z [2024-02-23 02:41:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[628da8be-e786-43b6-b09d-4bc272a6e684] received 2024-02-23T02:41:00.530647779Z [2024-02-23 02:41:00,530: INFO/ForkPoolWorker-16] [1be062bd-ea66-4b40-8def-23dfb37c219a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:41:00.534061636Z [2024-02-23 02:41:00,533: INFO/ForkPoolWorker-1] [0705e405-0882-4a5b-b17e-b9a3dafdd8e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:41:00.536543350Z [2024-02-23 02:41:00,536: INFO/ForkPoolWorker-2] [628da8be-e786-43b6-b09d-4bc272a6e684] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:41:00.539499411Z [2024-02-23 02:41:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c22db78-a964-4149-945d-6a4de4f07968] received 2024-02-23T02:41:00.557431422Z [2024-02-23 02:41:00,557: INFO/ForkPoolWorker-3] [2c22db78-a964-4149-945d-6a4de4f07968] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:41:00.939826900Z [2024-02-23 02:41:00,935: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:41:00.946113176Z [2024-02-23 02:41:00,943: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:41:01.056725680Z [2024-02-23 02:41:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:41:01.057392174Z [2024-02-23 02:41:01,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:41:01.229178361Z [2024-02-23 02:41:01,228: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T02:41:01.243155518Z [2024-02-23 02:41:01,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:01.260116298Z [2024-02-23 02:41:01,256: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:41:01.296956473Z [2024-02-23 02:41:01,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:41:01.300893495Z [2024-02-23 02:41:01,300: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:41:01.301354828Z [2024-02-23 02:41:01,300: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:41:01.301639980Z [2024-02-23 02:41:01,301: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T02:41:01.302133458Z [2024-02-23 02:41:01,301: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:41:01.437309889Z [2024-02-23 02:41:01,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:41:02.203421235Z [2024-02-23 02:41:02,203: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1a40f24-f233-4d72-9317-bd038bec24ba] succeeded in 1.690026124000724s: None 2024-02-23T02:41:02.547061658Z [2024-02-23 02:41:02,546: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:41:02.550462819Z [2024-02-23 02:41:02,550: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:02.577430891Z [2024-02-23 02:41:02,577: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:41:02.578929807Z [2024-02-23 02:41:02,578: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:41:02.579162474Z [2024-02-23 02:41:02,579: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:41:02.579406445Z [2024-02-23 02:41:02,579: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:41:02.579586669Z [2024-02-23 02:41:02,579: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:41:02.579948103Z [2024-02-23 02:41:02,579: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:41:02.580131970Z [2024-02-23 02:41:02,580: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:41:02.687706829Z [2024-02-23 02:41:02,687: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:41:02.689852644Z [2024-02-23 02:41:02,689: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:41:02.693275944Z [2024-02-23 02:41:02,692: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:02.735298517Z [2024-02-23 02:41:02,735: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:41:02.740404846Z [2024-02-23 02:41:02,740: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:41:02.740501730Z [2024-02-23 02:41:02,740: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:41:02.740685317Z [2024-02-23 02:41:02,740: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:41:02.740753589Z [2024-02-23 02:41:02,740: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:41:02.741062697Z [2024-02-23 02:41:02,740: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:41:02.741126593Z [2024-02-23 02:41:02,741: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:41:02.754421692Z [2024-02-23 02:41:02,754: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:41:02.757436620Z [2024-02-23 02:41:02,755: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:41:02.759126604Z [2024-02-23 02:41:02,758: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:41:02.763252098Z [2024-02-23 02:41:02,762: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:02.815879570Z [2024-02-23 02:41:02,815: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:41:02.820009048Z [2024-02-23 02:41:02,819: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:41:02.820030257Z [2024-02-23 02:41:02,819: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:41:02.820171938Z [2024-02-23 02:41:02,819: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:41:02.820228761Z [2024-02-23 02:41:02,820: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:41:02.820516488Z [2024-02-23 02:41:02,820: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:41:02.820583620Z [2024-02-23 02:41:02,820: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:41:02.824247555Z [2024-02-23 02:41:02,823: ERROR/ForkPoolWorker-2] [628da8be-e786-43b6-b09d-4bc272a6e684] Failed to execute task Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:41:02.824271559Z Traceback (most recent call last): 2024-02-23T02:41:02.824276792Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:41:02.824281095Z args.func(args) 2024-02-23T02:41:02.824285132Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:41:02.824289667Z return func(*args, **kwargs) 2024-02-23T02:41:02.824292961Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:41:02.824296390Z return f(*args, **kwargs) 2024-02-23T02:41:02.824313953Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:41:02.824317331Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:41:02.824320549Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:41:02.824324225Z raise AirflowException( 2024-02-23T02:41:02.824328418Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:41:02.861337253Z [2024-02-23 02:41:02,860: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[628da8be-e786-43b6-b09d-4bc272a6e684] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 628da8be-e786-43b6-b09d-4bc272a6e684') 2024-02-23T02:41:02.861360757Z Traceback (most recent call last): 2024-02-23T02:41:02.861365249Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:41:02.861368714Z R = retval = fun(*args, **kwargs) 2024-02-23T02:41:02.861372004Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:41:02.861375347Z return self.run(*args, **kwargs) 2024-02-23T02:41:02.861380749Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:41:02.861384785Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:41:02.861387997Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:41:02.861392103Z raise AirflowException(msg) 2024-02-23T02:41:02.861396191Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 628da8be-e786-43b6-b09d-4bc272a6e684 2024-02-23T02:41:02.894819275Z [2024-02-23 02:41:02,894: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:41:02.898019650Z [2024-02-23 02:41:02,897: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:02.930354813Z [2024-02-23 02:41:02,930: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:41:02.935305925Z [2024-02-23 02:41:02,935: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:41:02.935419799Z [2024-02-23 02:41:02,935: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:41:02.936886167Z [2024-02-23 02:41:02,936: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:41:02.937004672Z [2024-02-23 02:41:02,936: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:41:02.937528485Z [2024-02-23 02:41:02,937: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:41:02.937704467Z [2024-02-23 02:41:02,937: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:41:03.046613523Z [2024-02-23 02:41:03,046: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:41:03.076256187Z [2024-02-23 02:41:03,075: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T02:41:03.080033023Z [2024-02-23 02:41:03,079: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:03.105672187Z [2024-02-23 02:41:03,105: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:41:03.106895964Z [2024-02-23 02:41:03,106: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:41:03.107071475Z [2024-02-23 02:41:03,106: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:41:03.107288818Z [2024-02-23 02:41:03,107: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:41:03.107416991Z [2024-02-23 02:41:03,107: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T02:41:03.107775591Z [2024-02-23 02:41:03,107: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:41:03.107917062Z [2024-02-23 02:41:03,107: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:41:03.114032770Z [2024-02-23 02:41:03,113: WARNING/ForkPoolWorker-3] Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:41:03.115043628Z [2024-02-23 02:41:03,114: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:41:03.115945646Z [2024-02-23 02:41:03,115: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T02:41:03.118890316Z [2024-02-23 02:41:03,118: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:41:03.139799708Z [2024-02-23 02:41:03,139: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:41:03.141143213Z [2024-02-23 02:41:03,140: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:41:03.141319061Z [2024-02-23 02:41:03,141: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:41:03.141512731Z [2024-02-23 02:41:03,141: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:41:03.141674199Z [2024-02-23 02:41:03,141: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T02:41:03.141986273Z [2024-02-23 02:41:03,141: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:41:03.142165496Z [2024-02-23 02:41:03,142: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:41:03.145460958Z [2024-02-23 02:41:03,144: ERROR/ForkPoolWorker-3] [2c22db78-a964-4149-945d-6a4de4f07968] Failed to execute task Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse.. 2024-02-23T02:41:03.145476157Z Traceback (most recent call last): 2024-02-23T02:41:03.145491826Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-02-23T02:41:03.145495919Z args.func(args) 2024-02-23T02:41:03.145499651Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-02-23T02:41:03.145503414Z return func(*args, **kwargs) 2024-02-23T02:41:03.145506889Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-02-23T02:41:03.145510249Z return f(*args, **kwargs) 2024-02-23T02:41:03.145513448Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-02-23T02:41:03.145516734Z dag = get_dag(args.subdir, args.dag_id) 2024-02-23T02:41:03.145519910Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-02-23T02:41:03.145523113Z raise AirflowException( 2024-02-23T02:41:03.145526932Z airflow.exceptions.AirflowException: Dag 'vim_status_0efc7a49-b1e5-4c55-8f21-56fe8e1864cb' could not be found; either it does not exist or it failed to parse. 2024-02-23T02:41:03.175536738Z [2024-02-23 02:41:03,174: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2c22db78-a964-4149-945d-6a4de4f07968] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2c22db78-a964-4149-945d-6a4de4f07968') 2024-02-23T02:41:03.175547073Z Traceback (most recent call last): 2024-02-23T02:41:03.175551406Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-02-23T02:41:03.175575542Z R = retval = fun(*args, **kwargs) 2024-02-23T02:41:03.175579066Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-02-23T02:41:03.175582580Z return self.run(*args, **kwargs) 2024-02-23T02:41:03.175586639Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-02-23T02:41:03.175590845Z _execute_in_fork(command_to_exec, celery_task_id) 2024-02-23T02:41:03.175594210Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-02-23T02:41:03.175598201Z raise AirflowException(msg) 2024-02-23T02:41:03.175602306Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2c22db78-a964-4149-945d-6a4de4f07968 2024-02-23T02:41:05.139665249Z [2024-02-23 02:41:05,139: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0705e405-0882-4a5b-b17e-b9a3dafdd8e4] succeeded in 4.61236831899987s: None 2024-02-23T02:41:06.667380629Z [2024-02-23 02:41:06,666: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1be062bd-ea66-4b40-8def-23dfb37c219a] succeeded in 6.149110684000334s: None 2024-02-23T02:42:00.617768721Z [2024-02-23 02:42:00,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd75c3e5-7382-4fd6-8615-b6d844c6e7f6] received 2024-02-23T02:42:00.624795107Z [2024-02-23 02:42:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90c8dffd-8971-44b8-ad2b-47f645baa693] received 2024-02-23T02:42:00.625509375Z [2024-02-23 02:42:00,625: INFO/ForkPoolWorker-15] [dd75c3e5-7382-4fd6-8615-b6d844c6e7f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:42:00.635853121Z [2024-02-23 02:42:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba373f71-8328-40f0-8399-acb93e300d2e] received 2024-02-23T02:42:00.637551374Z [2024-02-23 02:42:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69e51448-7bf0-458b-8623-3909595f99c4] received 2024-02-23T02:42:00.641394395Z [2024-02-23 02:42:00,641: INFO/ForkPoolWorker-16] [90c8dffd-8971-44b8-ad2b-47f645baa693] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:42:00.649064487Z [2024-02-23 02:42:00,648: INFO/ForkPoolWorker-2] [69e51448-7bf0-458b-8623-3909595f99c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:42:00.664950126Z [2024-02-23 02:42:00,664: INFO/ForkPoolWorker-1] [ba373f71-8328-40f0-8399-acb93e300d2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:42:01.034432048Z [2024-02-23 02:42:01,030: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:42:01.177454613Z [2024-02-23 02:42:01,174: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:42:01.224844729Z [2024-02-23 02:42:01,224: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:42:01.228941388Z [2024-02-23 02:42:01,228: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:42:01.273081881Z [2024-02-23 02:42:01,272: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:42:01.274862531Z [2024-02-23 02:42:01,274: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:42:01.275041302Z [2024-02-23 02:42:01,274: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:42:01.275064079Z [2024-02-23 02:42:01,274: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:42:01.275236787Z [2024-02-23 02:42:01,275: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:42:01.325720601Z [2024-02-23 02:42:01,322: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:42:01.409951329Z [2024-02-23 02:42:01,409: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:42:01.442415201Z [2024-02-23 02:42:01,424: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:42:01.586937403Z [2024-02-23 02:42:01,586: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:42:02.254995193Z [2024-02-23 02:42:02,254: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba373f71-8328-40f0-8399-acb93e300d2e] succeeded in 1.6163903190008568s: None 2024-02-23T02:42:02.312979092Z [2024-02-23 02:42:02,312: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90c8dffd-8971-44b8-ad2b-47f645baa693] succeeded in 1.6770840319986746s: None 2024-02-23T02:42:02.794326572Z [2024-02-23 02:42:02,793: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:42:02.797688141Z [2024-02-23 02:42:02,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:42:02.818679670Z [2024-02-23 02:42:02,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:42:02.820776524Z [2024-02-23 02:42:02,820: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:42:02.820812232Z [2024-02-23 02:42:02,820: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:42:02.820998181Z [2024-02-23 02:42:02,820: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:42:02.821127889Z [2024-02-23 02:42:02,820: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:42:02.821489677Z [2024-02-23 02:42:02,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:42:02.821616544Z [2024-02-23 02:42:02,821: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:42:02.934462252Z [2024-02-23 02:42:02,934: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:42:03.113377624Z [2024-02-23 02:42:03,113: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:42:03.116548853Z [2024-02-23 02:42:03,116: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:42:03.137955886Z [2024-02-23 02:42:03,137: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:42:03.139137005Z [2024-02-23 02:42:03,138: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:42:03.139228741Z [2024-02-23 02:42:03,139: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:42:03.139656435Z [2024-02-23 02:42:03,139: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:42:03.139755996Z [2024-02-23 02:42:03,139: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:42:03.140005535Z [2024-02-23 02:42:03,139: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:42:03.140381764Z [2024-02-23 02:42:03,140: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:42:03.217277168Z [2024-02-23 02:42:03,217: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:42:04.987393252Z [2024-02-23 02:42:04,986: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd75c3e5-7382-4fd6-8615-b6d844c6e7f6] succeeded in 4.367695224998897s: None 2024-02-23T02:42:06.549885660Z [2024-02-23 02:42:06,549: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[69e51448-7bf0-458b-8623-3909595f99c4] succeeded in 5.909803872000339s: None 2024-02-23T02:43:00.673034338Z [2024-02-23 02:43:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5914d98f-dee0-434c-8400-5757f4aae1ec] received 2024-02-23T02:43:00.679387621Z [2024-02-23 02:43:00,679: INFO/ForkPoolWorker-15] [5914d98f-dee0-434c-8400-5757f4aae1ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:43:00.681524549Z [2024-02-23 02:43:00,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76095e6e-c059-47f1-a63d-177252c5a092] received 2024-02-23T02:43:00.684580837Z [2024-02-23 02:43:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c5fb6d4-5d0d-4ac6-bd73-f32dedf145f9] received 2024-02-23T02:43:00.697075176Z [2024-02-23 02:43:00,696: INFO/ForkPoolWorker-1] [0c5fb6d4-5d0d-4ac6-bd73-f32dedf145f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:43:00.697874559Z [2024-02-23 02:43:00,697: INFO/ForkPoolWorker-16] [76095e6e-c059-47f1-a63d-177252c5a092] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:43:01.018309136Z [2024-02-23 02:43:01,015: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:43:01.084911673Z [2024-02-23 02:43:01,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:43:01.110920830Z [2024-02-23 02:43:01,108: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:43:01.254602270Z [2024-02-23 02:43:01,254: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:43:01.258352604Z [2024-02-23 02:43:01,257: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:43:01.296788114Z [2024-02-23 02:43:01,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:43:01.298329540Z [2024-02-23 02:43:01,298: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:43:01.298449097Z [2024-02-23 02:43:01,298: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:43:01.298517053Z [2024-02-23 02:43:01,298: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:43:01.298726537Z [2024-02-23 02:43:01,298: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:43:01.380392386Z [2024-02-23 02:43:01,380: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:43:01.953839341Z [2024-02-23 02:43:01,953: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76095e6e-c059-47f1-a63d-177252c5a092] succeeded in 1.2707751720008673s: None 2024-02-23T02:43:02.327852166Z [2024-02-23 02:43:02,327: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:43:02.331182106Z [2024-02-23 02:43:02,330: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:43:02.353989271Z [2024-02-23 02:43:02,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:43:02.355766634Z [2024-02-23 02:43:02,355: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:43:02.355835971Z [2024-02-23 02:43:02,355: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:43:02.355912690Z [2024-02-23 02:43:02,355: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:43:02.355939857Z [2024-02-23 02:43:02,355: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:43:02.356252199Z [2024-02-23 02:43:02,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:43:02.356302433Z [2024-02-23 02:43:02,356: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:43:02.400809067Z [2024-02-23 02:43:02,400: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:43:02.403955948Z [2024-02-23 02:43:02,403: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:43:02.423327036Z [2024-02-23 02:43:02,423: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:43:02.424525192Z [2024-02-23 02:43:02,424: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:43:02.424545987Z [2024-02-23 02:43:02,424: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:43:02.424716365Z [2024-02-23 02:43:02,424: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:43:02.424730262Z [2024-02-23 02:43:02,424: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:43:02.424971974Z [2024-02-23 02:43:02,424: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:43:02.425044218Z [2024-02-23 02:43:02,424: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:43:02.430374512Z [2024-02-23 02:43:02,430: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:43:02.546419710Z [2024-02-23 02:43:02,546: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:43:04.138548586Z [2024-02-23 02:43:04,137: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c5fb6d4-5d0d-4ac6-bd73-f32dedf145f9] succeeded in 3.451606394000919s: None 2024-02-23T02:43:04.921384448Z [2024-02-23 02:43:04,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5914d98f-dee0-434c-8400-5757f4aae1ec] succeeded in 4.246711465999397s: None 2024-02-23T02:44:00.758150924Z [2024-02-23 02:44:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbab51ea-5da3-4f6f-b0f8-0fdf4ab76028] received 2024-02-23T02:44:00.766217711Z [2024-02-23 02:44:00,765: INFO/ForkPoolWorker-15] [cbab51ea-5da3-4f6f-b0f8-0fdf4ab76028] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:44:00.771645112Z [2024-02-23 02:44:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfaa26f5-3228-4cd2-baf0-d44525d62dfd] received 2024-02-23T02:44:00.777229484Z [2024-02-23 02:44:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6c0ec6b-54b3-4dc7-b499-860f85a626d1] received 2024-02-23T02:44:00.785841028Z [2024-02-23 02:44:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f65a926f-2bba-4769-8b5c-6a54f4d92e55] received 2024-02-23T02:44:00.787446241Z [2024-02-23 02:44:00,787: INFO/ForkPoolWorker-1] [f6c0ec6b-54b3-4dc7-b499-860f85a626d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:44:00.791892115Z [2024-02-23 02:44:00,791: INFO/ForkPoolWorker-16] [dfaa26f5-3228-4cd2-baf0-d44525d62dfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:44:00.793300903Z [2024-02-23 02:44:00,792: INFO/ForkPoolWorker-2] [f65a926f-2bba-4769-8b5c-6a54f4d92e55] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:44:01.098141834Z [2024-02-23 02:44:01,095: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:44:01.110399847Z [2024-02-23 02:44:01,107: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:44:01.126691943Z [2024-02-23 02:44:01,121: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:44:01.203236884Z [2024-02-23 02:44:01,192: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:44:01.274592464Z [2024-02-23 02:44:01,274: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:44:01.280463032Z [2024-02-23 02:44:01,280: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:44:01.302294160Z [2024-02-23 02:44:01,302: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:44:01.303405642Z [2024-02-23 02:44:01,303: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:44:01.303815715Z [2024-02-23 02:44:01,303: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:44:01.303927333Z [2024-02-23 02:44:01,303: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:44:01.304405836Z [2024-02-23 02:44:01,304: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:44:01.392943181Z [2024-02-23 02:44:01,392: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:44:01.546250608Z [2024-02-23 02:44:01,545: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:44:02.094313973Z [2024-02-23 02:44:02,093: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbab51ea-5da3-4f6f-b0f8-0fdf4ab76028] succeeded in 1.334666107000885s: None 2024-02-23T02:44:02.224744631Z [2024-02-23 02:44:02,224: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f65a926f-2bba-4769-8b5c-6a54f4d92e55] succeeded in 1.4360206889996334s: None 2024-02-23T02:44:02.624161508Z [2024-02-23 02:44:02,623: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:44:02.631010216Z [2024-02-23 02:44:02,630: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:44:02.653771904Z [2024-02-23 02:44:02,653: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:44:02.655290751Z [2024-02-23 02:44:02,654: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:44:02.655330405Z [2024-02-23 02:44:02,655: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:44:02.655563260Z [2024-02-23 02:44:02,655: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:44:02.655606347Z [2024-02-23 02:44:02,655: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:44:02.655830540Z [2024-02-23 02:44:02,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:44:02.655843184Z [2024-02-23 02:44:02,655: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:44:02.724949632Z [2024-02-23 02:44:02,724: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:44:02.730517870Z [2024-02-23 02:44:02,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:44:02.761607641Z [2024-02-23 02:44:02,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:44:02.762807784Z [2024-02-23 02:44:02,762: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:44:02.762877837Z [2024-02-23 02:44:02,762: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:44:02.762948276Z [2024-02-23 02:44:02,762: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:44:02.763002295Z [2024-02-23 02:44:02,762: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:44:02.763199696Z [2024-02-23 02:44:02,763: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:44:02.763308949Z [2024-02-23 02:44:02,763: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:44:02.779635937Z [2024-02-23 02:44:02,779: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:44:02.868338231Z [2024-02-23 02:44:02,867: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:44:05.039156905Z [2024-02-23 02:44:05,038: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6c0ec6b-54b3-4dc7-b499-860f85a626d1] succeeded in 4.258622877001471s: None 2024-02-23T02:44:05.392257398Z [2024-02-23 02:44:05,391: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfaa26f5-3228-4cd2-baf0-d44525d62dfd] succeeded in 4.618344608999905s: None 2024-02-23T02:45:00.722978949Z [2024-02-23 02:45:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ac983ac-1189-4965-bc41-300d917af752] received 2024-02-23T02:45:00.727402647Z [2024-02-23 02:45:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0a75a76-963c-451b-a82c-b87847e0d926] received 2024-02-23T02:45:00.741379059Z [2024-02-23 02:45:00,740: INFO/ForkPoolWorker-16] [d0a75a76-963c-451b-a82c-b87847e0d926] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:45:00.744110328Z [2024-02-23 02:45:00,743: INFO/ForkPoolWorker-15] [3ac983ac-1189-4965-bc41-300d917af752] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:45:00.762150354Z [2024-02-23 02:45:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[235c070b-480f-4b3d-a6c3-14afa1b78f38] received 2024-02-23T02:45:00.764826663Z [2024-02-23 02:45:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65b755ae-1aec-494e-b602-3ecae83d0908] received 2024-02-23T02:45:00.771970132Z [2024-02-23 02:45:00,771: INFO/ForkPoolWorker-1] [235c070b-480f-4b3d-a6c3-14afa1b78f38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:45:00.772555853Z [2024-02-23 02:45:00,772: INFO/ForkPoolWorker-2] [65b755ae-1aec-494e-b602-3ecae83d0908] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:45:01.163474210Z [2024-02-23 02:45:01,160: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:45:01.175360496Z [2024-02-23 02:45:01,172: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:45:01.250404381Z [2024-02-23 02:45:01,247: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:45:01.301899668Z [2024-02-23 02:45:01,296: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:45:01.351678398Z [2024-02-23 02:45:01,351: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:45:01.357869679Z [2024-02-23 02:45:01,357: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:01.398843231Z [2024-02-23 02:45:01,398: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:45:01.400337295Z [2024-02-23 02:45:01,400: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:45:01.400470316Z [2024-02-23 02:45:01,400: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:45:01.400505170Z [2024-02-23 02:45:01,400: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:45:01.400744141Z [2024-02-23 02:45:01,400: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:45:01.500116938Z [2024-02-23 02:45:01,499: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:02.067970124Z [2024-02-23 02:45:02,067: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[65b755ae-1aec-494e-b602-3ecae83d0908] succeeded in 1.3002817790002155s: None 2024-02-23T02:45:02.576197233Z [2024-02-23 02:45:02,575: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:45:02.579572120Z [2024-02-23 02:45:02,579: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:02.594028903Z [2024-02-23 02:45:02,593: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:45:02.599158311Z [2024-02-23 02:45:02,598: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:02.609875861Z [2024-02-23 02:45:02,609: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:45:02.611968047Z [2024-02-23 02:45:02,611: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:45:02.612544753Z [2024-02-23 02:45:02,611: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:45:02.612769207Z [2024-02-23 02:45:02,612: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:45:02.612831139Z [2024-02-23 02:45:02,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:45:02.613709643Z [2024-02-23 02:45:02,613: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:45:02.613858704Z [2024-02-23 02:45:02,613: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:45:02.647278601Z [2024-02-23 02:45:02,646: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:45:02.650733117Z [2024-02-23 02:45:02,650: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:02.653661189Z [2024-02-23 02:45:02,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:45:02.655362623Z [2024-02-23 02:45:02,655: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:45:02.655382200Z [2024-02-23 02:45:02,655: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:45:02.655526467Z [2024-02-23 02:45:02,655: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:45:02.655583105Z [2024-02-23 02:45:02,655: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:45:02.655847924Z [2024-02-23 02:45:02,655: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:45:02.656395670Z [2024-02-23 02:45:02,655: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:45:02.686162608Z [2024-02-23 02:45:02,685: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:45:02.689515687Z [2024-02-23 02:45:02,689: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:45:02.689534797Z [2024-02-23 02:45:02,689: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:45:02.689630269Z [2024-02-23 02:45:02,689: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:45:02.689667097Z [2024-02-23 02:45:02,689: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:45:02.690033091Z [2024-02-23 02:45:02,689: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:45:02.690043876Z [2024-02-23 02:45:02,689: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:45:02.713169933Z [2024-02-23 02:45:02,712: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:02.771557463Z [2024-02-23 02:45:02,771: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:02.806212437Z [2024-02-23 02:45:02,805: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:03.364453655Z [2024-02-23 02:45:03,363: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ac983ac-1189-4965-bc41-300d917af752] succeeded in 2.6389705470010085s: None 2024-02-23T02:45:03.793916023Z [2024-02-23 02:45:03,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38826254-ff71-451e-9f92-a19349a729d7] received 2024-02-23T02:45:03.801243492Z [2024-02-23 02:45:03,800: INFO/ForkPoolWorker-15] [38826254-ff71-451e-9f92-a19349a729d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:45:04.089604666Z [2024-02-23 02:45:04,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:45:04.368950406Z [2024-02-23 02:45:04,368: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[235c070b-480f-4b3d-a6c3-14afa1b78f38] succeeded in 3.6051428800001304s: None 2024-02-23T02:45:04.761961370Z [2024-02-23 02:45:04,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0a75a76-963c-451b-a82c-b87847e0d926] succeeded in 4.027537124000446s: None 2024-02-23T02:45:05.379326598Z [2024-02-23 02:45:05,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:45:05.382650771Z [2024-02-23 02:45:05,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:05.404755931Z [2024-02-23 02:45:05,404: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:45:05.406546605Z [2024-02-23 02:45:05,406: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:45:05.406650844Z [2024-02-23 02:45:05,406: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:45:05.406778492Z [2024-02-23 02:45:05,406: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:45:05.406851263Z [2024-02-23 02:45:05,406: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:45:05.407144820Z [2024-02-23 02:45:05,406: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:45:05.407268943Z [2024-02-23 02:45:05,407: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:45:05.516678777Z [2024-02-23 02:45:05,516: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:06.163693226Z [2024-02-23 02:45:06,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38826254-ff71-451e-9f92-a19349a729d7] succeeded in 2.3678691650002293s: None 2024-02-23T02:45:06.326382766Z [2024-02-23 02:45:06,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a24b4d5-4968-41a9-bb30-eb3e6360bcbd] received 2024-02-23T02:45:06.337015112Z [2024-02-23 02:45:06,336: INFO/ForkPoolWorker-15] [1a24b4d5-4968-41a9-bb30-eb3e6360bcbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:45:06.613079265Z [2024-02-23 02:45:06,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:45:07.736214697Z [2024-02-23 02:45:07,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:45:07.739679438Z [2024-02-23 02:45:07,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:07.759085182Z [2024-02-23 02:45:07,758: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:45:07.760912140Z [2024-02-23 02:45:07,760: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:45:07.761169594Z [2024-02-23 02:45:07,760: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:45:07.761496964Z [2024-02-23 02:45:07,761: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:45:07.761797713Z [2024-02-23 02:45:07,761: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:45:07.762351614Z [2024-02-23 02:45:07,762: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:45:07.762557716Z [2024-02-23 02:45:07,762: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:45:07.874440702Z [2024-02-23 02:45:07,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:08.458388329Z [2024-02-23 02:45:08,458: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a24b4d5-4968-41a9-bb30-eb3e6360bcbd] succeeded in 2.1286551490011334s: None 2024-02-23T02:45:08.633585076Z [2024-02-23 02:45:08,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c58d12b-9d52-4153-b6ae-0391bff7abcd] received 2024-02-23T02:45:08.658390976Z [2024-02-23 02:45:08,658: INFO/ForkPoolWorker-15] [1c58d12b-9d52-4153-b6ae-0391bff7abcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:45:08.986491141Z [2024-02-23 02:45:08,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:45:10.181167282Z [2024-02-23 02:45:10,180: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:45:10.184343419Z [2024-02-23 02:45:10,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:45:10.202920971Z [2024-02-23 02:45:10,202: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:45:10.204420435Z [2024-02-23 02:45:10,204: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:45:10.204524714Z [2024-02-23 02:45:10,204: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:45:10.204723611Z [2024-02-23 02:45:10,204: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:45:10.204798153Z [2024-02-23 02:45:10,204: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:45:10.205107636Z [2024-02-23 02:45:10,204: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:45:10.205220404Z [2024-02-23 02:45:10,205: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:45:10.281123698Z [2024-02-23 02:45:10,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:45:10.859556218Z [2024-02-23 02:45:10,858: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c58d12b-9d52-4153-b6ae-0391bff7abcd] succeeded in 2.21799244399881s: None 2024-02-23T02:46:00.449211750Z [2024-02-23 02:46:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0062def-ac4a-4317-bc9c-f349901ffcca] received 2024-02-23T02:46:00.451208755Z [2024-02-23 02:46:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ceeba54-d571-44d5-8f80-3b9e5d185ad5] received 2024-02-23T02:46:00.457274465Z [2024-02-23 02:46:00,457: INFO/ForkPoolWorker-15] [d0062def-ac4a-4317-bc9c-f349901ffcca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:46:00.460121189Z [2024-02-23 02:46:00,459: INFO/ForkPoolWorker-16] [4ceeba54-d571-44d5-8f80-3b9e5d185ad5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:46:00.463650599Z [2024-02-23 02:46:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22b0dcb2-abb2-4223-893c-08cbdf5e9ead] received 2024-02-23T02:46:00.470208826Z [2024-02-23 02:46:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39e65f6f-3e58-4f10-ae01-ae03ac672631] received 2024-02-23T02:46:00.478635004Z [2024-02-23 02:46:00,478: INFO/ForkPoolWorker-2] [39e65f6f-3e58-4f10-ae01-ae03ac672631] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:46:00.479030775Z [2024-02-23 02:46:00,478: INFO/ForkPoolWorker-1] [22b0dcb2-abb2-4223-893c-08cbdf5e9ead] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:46:00.766713199Z [2024-02-23 02:46:00,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:46:00.803074880Z [2024-02-23 02:46:00,799: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:46:00.815093062Z [2024-02-23 02:46:00,812: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:46:00.931392873Z [2024-02-23 02:46:00,928: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:46:01.021815053Z [2024-02-23 02:46:01,021: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:46:01.027048648Z [2024-02-23 02:46:01,026: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:46:01.027690315Z [2024-02-23 02:46:01,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:46:01.074369100Z [2024-02-23 02:46:01,074: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:46:01.075666483Z [2024-02-23 02:46:01,075: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:46:01.075876806Z [2024-02-23 02:46:01,075: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:46:01.076068621Z [2024-02-23 02:46:01,075: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:46:01.077269911Z [2024-02-23 02:46:01,077: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:46:01.233463635Z [2024-02-23 02:46:01,233: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:46:01.872973008Z [2024-02-23 02:46:01,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d0062def-ac4a-4317-bc9c-f349901ffcca] succeeded in 1.4204435119991103s: None 2024-02-23T02:46:02.116994193Z [2024-02-23 02:46:02,116: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39e65f6f-3e58-4f10-ae01-ae03ac672631] succeeded in 1.643859177000195s: None 2024-02-23T02:46:02.457346501Z [2024-02-23 02:46:02,456: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:46:02.460945740Z [2024-02-23 02:46:02,460: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:46:02.485034824Z [2024-02-23 02:46:02,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:46:02.486447303Z [2024-02-23 02:46:02,486: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:46:02.486937208Z [2024-02-23 02:46:02,486: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:46:02.487267603Z [2024-02-23 02:46:02,486: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:46:02.487437371Z [2024-02-23 02:46:02,487: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:46:02.487841991Z [2024-02-23 02:46:02,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:46:02.488028709Z [2024-02-23 02:46:02,487: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:46:02.609212982Z [2024-02-23 02:46:02,608: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:46:02.616869716Z [2024-02-23 02:46:02,616: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:46:02.620287598Z [2024-02-23 02:46:02,619: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:46:02.658142807Z [2024-02-23 02:46:02,657: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:46:02.659756088Z [2024-02-23 02:46:02,659: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:46:02.660007999Z [2024-02-23 02:46:02,659: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:46:02.660286552Z [2024-02-23 02:46:02,659: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:46:02.660481787Z [2024-02-23 02:46:02,660: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:46:02.660835875Z [2024-02-23 02:46:02,660: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:46:02.660951953Z [2024-02-23 02:46:02,660: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:46:02.746614771Z [2024-02-23 02:46:02,746: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:46:04.251482292Z [2024-02-23 02:46:04,251: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22b0dcb2-abb2-4223-893c-08cbdf5e9ead] succeeded in 3.7783730369992554s: None 2024-02-23T02:46:04.571733463Z [2024-02-23 02:46:04,571: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ceeba54-d571-44d5-8f80-3b9e5d185ad5] succeeded in 4.1170117239998945s: None 2024-02-23T02:47:00.425984684Z [2024-02-23 02:47:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb11c631-5ea6-403c-9465-4dfa0d4b3408] received 2024-02-23T02:47:00.428367655Z [2024-02-23 02:47:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbf19e8d-fd00-4159-96b5-3cc3485abb13] received 2024-02-23T02:47:00.444857435Z [2024-02-23 02:47:00,444: INFO/ForkPoolWorker-16] [dbf19e8d-fd00-4159-96b5-3cc3485abb13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:47:00.449866136Z [2024-02-23 02:47:00,449: INFO/ForkPoolWorker-15] [eb11c631-5ea6-403c-9465-4dfa0d4b3408] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:47:00.455907758Z [2024-02-23 02:47:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cccc6c4-1ba5-401c-890e-84239b67bb2b] received 2024-02-23T02:47:00.479647165Z [2024-02-23 02:47:00,479: INFO/ForkPoolWorker-1] [0cccc6c4-1ba5-401c-890e-84239b67bb2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:47:00.886145206Z [2024-02-23 02:47:00,882: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:47:00.961885077Z [2024-02-23 02:47:00,956: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:47:01.047718899Z [2024-02-23 02:47:01,040: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:47:01.209051546Z [2024-02-23 02:47:01,208: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:47:01.223854363Z [2024-02-23 02:47:01,223: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:47:01.283783807Z [2024-02-23 02:47:01,283: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:47:01.291934582Z [2024-02-23 02:47:01,291: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:47:01.295934049Z [2024-02-23 02:47:01,291: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:47:01.295972359Z [2024-02-23 02:47:01,293: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:47:01.295983080Z [2024-02-23 02:47:01,294: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:47:01.438115382Z [2024-02-23 02:47:01,437: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:47:02.494447179Z [2024-02-23 02:47:02,493: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0cccc6c4-1ba5-401c-890e-84239b67bb2b] succeeded in 2.035166573999959s: None 2024-02-23T02:47:02.598118022Z [2024-02-23 02:47:02,597: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:47:02.602335298Z [2024-02-23 02:47:02,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:47:02.630971263Z [2024-02-23 02:47:02,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:47:02.632355333Z [2024-02-23 02:47:02,632: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:47:02.632446851Z [2024-02-23 02:47:02,632: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:47:02.632596215Z [2024-02-23 02:47:02,632: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:47:02.632671523Z [2024-02-23 02:47:02,632: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:47:02.632954248Z [2024-02-23 02:47:02,632: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:47:02.633079124Z [2024-02-23 02:47:02,632: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:47:02.751720548Z [2024-02-23 02:47:02,750: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:47:02.755527274Z [2024-02-23 02:47:02,754: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:47:02.762250608Z [2024-02-23 02:47:02,761: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:47:02.812737488Z [2024-02-23 02:47:02,812: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:47:02.820075404Z [2024-02-23 02:47:02,819: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:47:02.820119803Z [2024-02-23 02:47:02,819: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:47:02.820349115Z [2024-02-23 02:47:02,820: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:47:02.820386934Z [2024-02-23 02:47:02,820: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:47:02.820793210Z [2024-02-23 02:47:02,820: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:47:02.820816369Z [2024-02-23 02:47:02,820: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:47:02.994934642Z [2024-02-23 02:47:02,994: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:47:04.889587708Z [2024-02-23 02:47:04,889: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb11c631-5ea6-403c-9465-4dfa0d4b3408] succeeded in 4.456927597999311s: None 2024-02-23T02:47:05.553473318Z [2024-02-23 02:47:05,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbf19e8d-fd00-4159-96b5-3cc3485abb13] succeeded in 5.120914257999175s: None 2024-02-23T02:48:00.256989272Z [2024-02-23 02:48:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6826c44d-9571-44e1-9a37-f6a20af4acf2] received 2024-02-23T02:48:00.258634729Z [2024-02-23 02:48:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[324fc224-e462-4491-8ebf-1ed6a5f12f71] received 2024-02-23T02:48:00.266218432Z [2024-02-23 02:48:00,265: INFO/ForkPoolWorker-15] [6826c44d-9571-44e1-9a37-f6a20af4acf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:48:00.270689664Z [2024-02-23 02:48:00,270: INFO/ForkPoolWorker-16] [324fc224-e462-4491-8ebf-1ed6a5f12f71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:48:00.280012785Z [2024-02-23 02:48:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cbbed32-3fd7-4f5e-85d9-158b362a4648] received 2024-02-23T02:48:00.287271429Z [2024-02-23 02:48:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd5be166-cd14-4a7d-bbb0-42fc82e68361] received 2024-02-23T02:48:00.301516318Z [2024-02-23 02:48:00,301: INFO/ForkPoolWorker-1] [1cbbed32-3fd7-4f5e-85d9-158b362a4648] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:48:00.303485694Z [2024-02-23 02:48:00,303: INFO/ForkPoolWorker-2] [dd5be166-cd14-4a7d-bbb0-42fc82e68361] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:48:00.570041128Z [2024-02-23 02:48:00,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:48:00.610624282Z [2024-02-23 02:48:00,607: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:48:00.690487545Z [2024-02-23 02:48:00,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:48:00.755170642Z [2024-02-23 02:48:00,751: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:48:00.860933966Z [2024-02-23 02:48:00,860: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:48:00.937182626Z [2024-02-23 02:48:00,936: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:48:00.942344720Z [2024-02-23 02:48:00,941: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:48:00.972962570Z [2024-02-23 02:48:00,972: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:48:00.974143220Z [2024-02-23 02:48:00,973: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:48:00.974228868Z [2024-02-23 02:48:00,974: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:48:00.974346638Z [2024-02-23 02:48:00,974: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:48:00.974571791Z [2024-02-23 02:48:00,974: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:48:01.127664680Z [2024-02-23 02:48:01,127: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:48:01.495514357Z [2024-02-23 02:48:01,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6826c44d-9571-44e1-9a37-f6a20af4acf2] succeeded in 1.2355888210004196s: None 2024-02-23T02:48:01.679534103Z [2024-02-23 02:48:01,679: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dd5be166-cd14-4a7d-bbb0-42fc82e68361] succeeded in 1.3902930099993682s: None 2024-02-23T02:48:01.897068383Z [2024-02-23 02:48:01,896: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:48:01.902484413Z [2024-02-23 02:48:01,901: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:48:01.926658867Z [2024-02-23 02:48:01,926: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:48:01.928767893Z [2024-02-23 02:48:01,928: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:48:01.928794889Z [2024-02-23 02:48:01,928: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:48:01.928951479Z [2024-02-23 02:48:01,928: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:48:01.929004685Z [2024-02-23 02:48:01,928: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:48:01.929246092Z [2024-02-23 02:48:01,929: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:48:01.929632320Z [2024-02-23 02:48:01,929: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:48:02.007636652Z [2024-02-23 02:48:02,007: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:48:02.010966224Z [2024-02-23 02:48:02,010: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:48:02.039867697Z [2024-02-23 02:48:02,039: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:48:02.041802235Z [2024-02-23 02:48:02,041: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:48:02.041863875Z [2024-02-23 02:48:02,041: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:48:02.042033107Z [2024-02-23 02:48:02,041: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:48:02.042100900Z [2024-02-23 02:48:02,042: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:48:02.042395821Z [2024-02-23 02:48:02,042: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:48:02.042487352Z [2024-02-23 02:48:02,042: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:48:02.048705454Z [2024-02-23 02:48:02,048: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:48:02.128976394Z [2024-02-23 02:48:02,128: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:48:03.810534747Z [2024-02-23 02:48:03,809: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1cbbed32-3fd7-4f5e-85d9-158b362a4648] succeeded in 3.5280570190006983s: None 2024-02-23T02:48:04.559054128Z [2024-02-23 02:48:04,558: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[324fc224-e462-4491-8ebf-1ed6a5f12f71] succeeded in 4.298329519000617s: None 2024-02-23T02:49:01.215001540Z [2024-02-23 02:49:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17357559-fd06-4eba-87cf-27d9e3d2dbcd] received 2024-02-23T02:49:01.215261225Z [2024-02-23 02:49:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5412a3e5-b907-4186-91ef-f9f728530e13] received 2024-02-23T02:49:01.219957253Z [2024-02-23 02:49:01,219: INFO/ForkPoolWorker-15] [17357559-fd06-4eba-87cf-27d9e3d2dbcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:49:01.223741284Z [2024-02-23 02:49:01,223: INFO/ForkPoolWorker-16] [5412a3e5-b907-4186-91ef-f9f728530e13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:49:01.229621632Z [2024-02-23 02:49:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d81d9e56-1589-472f-a1af-4f3e95903d8c] received 2024-02-23T02:49:01.251277277Z [2024-02-23 02:49:01,250: INFO/ForkPoolWorker-1] [d81d9e56-1589-472f-a1af-4f3e95903d8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:49:01.492937997Z [2024-02-23 02:49:01,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:49:01.538543243Z [2024-02-23 02:49:01,535: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:49:01.641115692Z [2024-02-23 02:49:01,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:49:01.819988015Z [2024-02-23 02:49:01,819: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:49:01.824430034Z [2024-02-23 02:49:01,823: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:49:01.855919020Z [2024-02-23 02:49:01,855: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:49:01.857857480Z [2024-02-23 02:49:01,857: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:49:01.858111371Z [2024-02-23 02:49:01,857: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:49:01.858345244Z [2024-02-23 02:49:01,858: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:49:01.858785435Z [2024-02-23 02:49:01,858: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:49:01.969074661Z [2024-02-23 02:49:01,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:49:02.577016624Z [2024-02-23 02:49:02,576: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d81d9e56-1589-472f-a1af-4f3e95903d8c] succeeded in 1.3393858210001781s: None 2024-02-23T02:49:02.717470089Z [2024-02-23 02:49:02,717: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:49:02.721322048Z [2024-02-23 02:49:02,720: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:49:02.743992331Z [2024-02-23 02:49:02,743: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:49:02.753292476Z [2024-02-23 02:49:02,752: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:49:02.754226762Z [2024-02-23 02:49:02,753: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:49:02.754522469Z [2024-02-23 02:49:02,754: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:49:02.754732429Z [2024-02-23 02:49:02,754: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:49:02.755259381Z [2024-02-23 02:49:02,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:49:02.755479054Z [2024-02-23 02:49:02,755: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:49:02.826950787Z [2024-02-23 02:49:02,826: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:49:02.830417839Z [2024-02-23 02:49:02,829: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:49:02.851965796Z [2024-02-23 02:49:02,851: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:49:02.853404789Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:49:02.853521734Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:49:02.853725096Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:49:02.853787694Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:49:02.854046619Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:49:02.854060541Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:49:02.854100859Z [2024-02-23 02:49:02,853: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:49:02.948396336Z [2024-02-23 02:49:02,948: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:49:04.872809303Z [2024-02-23 02:49:04,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17357559-fd06-4eba-87cf-27d9e3d2dbcd] succeeded in 3.6592518540001038s: None 2024-02-23T02:49:05.269830041Z [2024-02-23 02:49:05,269: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5412a3e5-b907-4186-91ef-f9f728530e13] succeeded in 4.051945011000498s: None 2024-02-23T02:50:01.075505359Z [2024-02-23 02:50:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c421900-accd-4325-817e-05bb12ea8b77] received 2024-02-23T02:50:01.092674461Z [2024-02-23 02:50:01,092: INFO/ForkPoolWorker-15] [2c421900-accd-4325-817e-05bb12ea8b77] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:50:01.099409229Z [2024-02-23 02:50:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd3ebb0b-c457-47ef-b697-1329eb33f1cc] received 2024-02-23T02:50:01.111411589Z [2024-02-23 02:50:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[898e3d25-ec47-41b6-b391-f7ebebe6b4be] received 2024-02-23T02:50:01.116323304Z [2024-02-23 02:50:01,116: INFO/ForkPoolWorker-16] [bd3ebb0b-c457-47ef-b697-1329eb33f1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:50:01.122140504Z [2024-02-23 02:50:01,121: INFO/ForkPoolWorker-1] [898e3d25-ec47-41b6-b391-f7ebebe6b4be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:50:01.126972376Z [2024-02-23 02:50:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc4344b6-f7d8-449b-8494-6f740f7973c8] received 2024-02-23T02:50:01.129011614Z [2024-02-23 02:50:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58778ecc-78a5-48e6-8148-3bd49ec4126d] received 2024-02-23T02:50:01.140701861Z [2024-02-23 02:50:01,140: INFO/ForkPoolWorker-2] [cc4344b6-f7d8-449b-8494-6f740f7973c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:50:01.145721954Z [2024-02-23 02:50:01,145: INFO/ForkPoolWorker-3] [58778ecc-78a5-48e6-8148-3bd49ec4126d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:50:01.544371199Z [2024-02-23 02:50:01,539: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:50:01.617370131Z [2024-02-23 02:50:01,613: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:50:01.717976854Z [2024-02-23 02:50:01,709: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:50:01.789505539Z [2024-02-23 02:50:01,785: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:50:01.857251004Z [2024-02-23 02:50:01,852: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:50:01.891579444Z [2024-02-23 02:50:01,891: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:02.007400536Z [2024-02-23 02:50:02,001: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T02:50:02.011391660Z [2024-02-23 02:50:02,010: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:02.059725580Z [2024-02-23 02:50:02,059: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:50:02.061907395Z [2024-02-23 02:50:02,061: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:50:02.062090070Z [2024-02-23 02:50:02,061: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:50:02.062225831Z [2024-02-23 02:50:02,062: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T02:50:02.062492126Z [2024-02-23 02:50:02,062: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:50:02.226045096Z [2024-02-23 02:50:02,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:02.463634080Z [2024-02-23 02:50:02,463: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cc4344b6-f7d8-449b-8494-6f740f7973c8] succeeded in 1.3316977710001083s: None 2024-02-23T02:50:02.810037254Z [2024-02-23 02:50:02,809: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c421900-accd-4325-817e-05bb12ea8b77] succeeded in 1.7304456849997223s: None 2024-02-23T02:50:03.189573972Z [2024-02-23 02:50:03,189: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T02:50:03.193956486Z [2024-02-23 02:50:03,193: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:03.231679683Z [2024-02-23 02:50:03,231: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T02:50:03.234333670Z [2024-02-23 02:50:03,233: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:50:03.234467780Z [2024-02-23 02:50:03,234: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:50:03.234710257Z [2024-02-23 02:50:03,234: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:50:03.234879948Z [2024-02-23 02:50:03,234: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T02:50:03.235328527Z [2024-02-23 02:50:03,235: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:50:03.235891413Z [2024-02-23 02:50:03,235: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:50:03.278363212Z [2024-02-23 02:50:03,277: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:50:03.281775747Z [2024-02-23 02:50:03,281: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:03.298610186Z [2024-02-23 02:50:03,298: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:50:03.302185295Z [2024-02-23 02:50:03,301: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:50:03.302209695Z [2024-02-23 02:50:03,302: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:50:03.302483794Z [2024-02-23 02:50:03,302: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:50:03.302504051Z [2024-02-23 02:50:03,302: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:50:03.303296425Z [2024-02-23 02:50:03,303: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:50:03.303407726Z [2024-02-23 02:50:03,303: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:50:03.363740101Z [2024-02-23 02:50:03,360: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:03.378955697Z [2024-02-23 02:50:03,378: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:50:03.381869008Z [2024-02-23 02:50:03,381: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:03.382644773Z [2024-02-23 02:50:03,382: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:03.403501554Z [2024-02-23 02:50:03,403: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:50:03.405109566Z [2024-02-23 02:50:03,404: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:50:03.405212767Z [2024-02-23 02:50:03,405: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:50:03.405425436Z [2024-02-23 02:50:03,405: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:50:03.405500225Z [2024-02-23 02:50:03,405: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:50:03.406293494Z [2024-02-23 02:50:03,406: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:50:03.406397913Z [2024-02-23 02:50:03,406: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:50:03.484487648Z [2024-02-23 02:50:03,484: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:04.079189171Z [2024-02-23 02:50:04,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad643aef-93f0-4f89-9a8b-e0a555880f43] received 2024-02-23T02:50:04.088769241Z [2024-02-23 02:50:04,088: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd3ebb0b-c457-47ef-b697-1329eb33f1cc] succeeded in 2.985499651998907s: None 2024-02-23T02:50:04.089151591Z [2024-02-23 02:50:04,088: INFO/ForkPoolWorker-15] [ad643aef-93f0-4f89-9a8b-e0a555880f43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:50:04.360874089Z [2024-02-23 02:50:04,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:50:05.537405669Z [2024-02-23 02:50:05,536: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[58778ecc-78a5-48e6-8148-3bd49ec4126d] succeeded in 4.406482730999414s: None 2024-02-23T02:50:05.547133223Z [2024-02-23 02:50:05,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:50:05.550639032Z [2024-02-23 02:50:05,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:05.589689962Z [2024-02-23 02:50:05,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:50:05.592887851Z [2024-02-23 02:50:05,592: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:50:05.592989933Z [2024-02-23 02:50:05,592: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:50:05.593448086Z [2024-02-23 02:50:05,592: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:50:05.593602869Z [2024-02-23 02:50:05,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:50:05.594009820Z [2024-02-23 02:50:05,593: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:50:05.594077994Z [2024-02-23 02:50:05,593: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:50:05.606390817Z [2024-02-23 02:50:05,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[898e3d25-ec47-41b6-b391-f7ebebe6b4be] succeeded in 4.493097463000595s: None 2024-02-23T02:50:05.739767313Z [2024-02-23 02:50:05,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:06.458982768Z [2024-02-23 02:50:06,458: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad643aef-93f0-4f89-9a8b-e0a555880f43] succeeded in 2.377623719999974s: None 2024-02-23T02:50:06.609258520Z [2024-02-23 02:50:06,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1770c4d-cc4f-4743-bf8b-6f4f3a9a868b] received 2024-02-23T02:50:06.620335441Z [2024-02-23 02:50:06,619: INFO/ForkPoolWorker-15] [f1770c4d-cc4f-4743-bf8b-6f4f3a9a868b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:50:06.948010492Z [2024-02-23 02:50:06,944: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:50:08.133419146Z [2024-02-23 02:50:08,132: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:50:08.136963122Z [2024-02-23 02:50:08,136: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:08.157052419Z [2024-02-23 02:50:08,156: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:50:08.158344646Z [2024-02-23 02:50:08,158: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:50:08.158363048Z [2024-02-23 02:50:08,158: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:50:08.158509935Z [2024-02-23 02:50:08,158: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:50:08.158537581Z [2024-02-23 02:50:08,158: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:50:08.158785764Z [2024-02-23 02:50:08,158: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:50:08.158925719Z [2024-02-23 02:50:08,158: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:50:08.274466560Z [2024-02-23 02:50:08,274: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:08.871941271Z [2024-02-23 02:50:08,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1770c4d-cc4f-4743-bf8b-6f4f3a9a868b] succeeded in 2.2607680809996964s: None 2024-02-23T02:50:08.987493848Z [2024-02-23 02:50:08,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b4aba44-525b-4cbb-b6b5-c3577f426ed0] received 2024-02-23T02:50:09.011157351Z [2024-02-23 02:50:09,009: INFO/ForkPoolWorker-15] [1b4aba44-525b-4cbb-b6b5-c3577f426ed0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:50:09.371795919Z [2024-02-23 02:50:09,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:50:10.517145518Z [2024-02-23 02:50:10,516: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:50:10.520180415Z [2024-02-23 02:50:10,519: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:50:10.547010357Z [2024-02-23 02:50:10,546: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:50:10.548672825Z [2024-02-23 02:50:10,548: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:50:10.548928969Z [2024-02-23 02:50:10,548: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:50:10.549199877Z [2024-02-23 02:50:10,548: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:50:10.549409232Z [2024-02-23 02:50:10,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:50:10.549925673Z [2024-02-23 02:50:10,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:50:10.550184693Z [2024-02-23 02:50:10,549: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:50:10.654404177Z [2024-02-23 02:50:10,653: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:50:11.266871334Z [2024-02-23 02:50:11,266: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b4aba44-525b-4cbb-b6b5-c3577f426ed0] succeeded in 2.2752901750009187s: None 2024-02-23T02:51:00.897969966Z [2024-02-23 02:51:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f9e66af-62d5-4e5c-9cd9-87f5596c333e] received 2024-02-23T02:51:00.902947723Z [2024-02-23 02:51:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8765f98-5c05-4c82-9f41-b6f5a204115a] received 2024-02-23T02:51:00.912729373Z [2024-02-23 02:51:00,912: INFO/ForkPoolWorker-16] [a8765f98-5c05-4c82-9f41-b6f5a204115a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:51:00.921173242Z [2024-02-23 02:51:00,917: INFO/ForkPoolWorker-15] [1f9e66af-62d5-4e5c-9cd9-87f5596c333e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:51:00.921237817Z [2024-02-23 02:51:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66dd63cd-3e47-48fc-ad9f-74769b9637ae] received 2024-02-23T02:51:00.939099890Z [2024-02-23 02:51:00,938: INFO/ForkPoolWorker-1] [66dd63cd-3e47-48fc-ad9f-74769b9637ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:51:01.226301280Z [2024-02-23 02:51:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:51:01.282209334Z [2024-02-23 02:51:01,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:51:01.316360534Z [2024-02-23 02:51:01,313: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:51:01.460045951Z [2024-02-23 02:51:01,459: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T02:51:01.464093612Z [2024-02-23 02:51:01,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:51:01.501576249Z [2024-02-23 02:51:01,501: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:51:01.508025706Z [2024-02-23 02:51:01,507: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:51:01.508123336Z [2024-02-23 02:51:01,507: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:51:01.508162839Z [2024-02-23 02:51:01,508: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T02:51:01.508417714Z [2024-02-23 02:51:01,508: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:51:01.610634386Z [2024-02-23 02:51:01,610: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:51:02.511380408Z [2024-02-23 02:51:02,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f9e66af-62d5-4e5c-9cd9-87f5596c333e] succeeded in 1.6118387669994263s: None 2024-02-23T02:51:02.697643613Z [2024-02-23 02:51:02,697: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:51:02.701257322Z [2024-02-23 02:51:02,700: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:51:02.739811699Z [2024-02-23 02:51:02,739: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:51:02.744889844Z [2024-02-23 02:51:02,744: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:51:02.748236554Z [2024-02-23 02:51:02,747: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:51:02.748543202Z [2024-02-23 02:51:02,748: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:51:02.748917928Z [2024-02-23 02:51:02,748: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:51:02.749343544Z [2024-02-23 02:51:02,749: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:51:02.751026145Z [2024-02-23 02:51:02,749: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:51:02.782964615Z [2024-02-23 02:51:02,782: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:51:02.786373071Z [2024-02-23 02:51:02,785: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:51:02.822799681Z [2024-02-23 02:51:02,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:51:02.828897571Z [2024-02-23 02:51:02,824: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:51:02.828932712Z [2024-02-23 02:51:02,828: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:51:02.829065861Z [2024-02-23 02:51:02,828: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:51:02.829156117Z [2024-02-23 02:51:02,829: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:51:02.829468104Z [2024-02-23 02:51:02,829: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:51:02.835230558Z [2024-02-23 02:51:02,834: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:51:02.840759288Z [2024-02-23 02:51:02,840: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:51:02.951090828Z [2024-02-23 02:51:02,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:51:04.828938016Z [2024-02-23 02:51:04,828: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66dd63cd-3e47-48fc-ad9f-74769b9637ae] succeeded in 3.906497133999437s: None 2024-02-23T02:51:05.333626491Z [2024-02-23 02:51:05,333: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8765f98-5c05-4c82-9f41-b6f5a204115a] succeeded in 4.428381564999654s: None 2024-02-23T02:52:00.792102371Z [2024-02-23 02:52:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22e2c768-3159-4078-8cec-b2e79a702eeb] received 2024-02-23T02:52:00.798185572Z [2024-02-23 02:52:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45ebf5b6-548a-498d-866b-4e1f6594c93f] received 2024-02-23T02:52:00.804746850Z [2024-02-23 02:52:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a49a7cb-0141-443c-b3dd-998d156ad5f9] received 2024-02-23T02:52:00.811018011Z [2024-02-23 02:52:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[331007a1-0151-477a-97ad-d9377e4a8e9c] received 2024-02-23T02:52:00.812550462Z [2024-02-23 02:52:00,812: INFO/ForkPoolWorker-15] [22e2c768-3159-4078-8cec-b2e79a702eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:52:00.814681877Z [2024-02-23 02:52:00,814: INFO/ForkPoolWorker-16] [45ebf5b6-548a-498d-866b-4e1f6594c93f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:52:00.822904405Z [2024-02-23 02:52:00,822: INFO/ForkPoolWorker-1] [8a49a7cb-0141-443c-b3dd-998d156ad5f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:52:00.824469259Z [2024-02-23 02:52:00,824: INFO/ForkPoolWorker-2] [331007a1-0151-477a-97ad-d9377e4a8e9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:52:01.192448527Z [2024-02-23 02:52:01,186: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:52:01.239568899Z [2024-02-23 02:52:01,236: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:52:01.429951459Z [2024-02-23 02:52:01,429: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:52:01.434411236Z [2024-02-23 02:52:01,433: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:52:01.464122042Z [2024-02-23 02:52:01,463: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:52:01.469750928Z [2024-02-23 02:52:01,469: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:52:01.471375509Z [2024-02-23 02:52:01,463: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:52:01.471787154Z [2024-02-23 02:52:01,471: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:52:01.472083431Z [2024-02-23 02:52:01,471: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:52:01.472261354Z [2024-02-23 02:52:01,472: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:52:01.472712898Z [2024-02-23 02:52:01,472: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:52:01.542312659Z [2024-02-23 02:52:01,533: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:52:01.633672016Z [2024-02-23 02:52:01,633: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:52:02.304114682Z [2024-02-23 02:52:02,303: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22e2c768-3159-4078-8cec-b2e79a702eeb] succeeded in 1.5041110380007012s: None 2024-02-23T02:52:02.396212876Z [2024-02-23 02:52:02,395: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[331007a1-0151-477a-97ad-d9377e4a8e9c] succeeded in 1.5834294510004838s: None 2024-02-23T02:52:02.982980014Z [2024-02-23 02:52:02,982: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:52:02.986308744Z [2024-02-23 02:52:02,985: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:52:03.012715077Z [2024-02-23 02:52:03,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:52:03.014326238Z [2024-02-23 02:52:03,014: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:52:03.014455158Z [2024-02-23 02:52:03,014: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:52:03.014633999Z [2024-02-23 02:52:03,014: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:52:03.014746626Z [2024-02-23 02:52:03,014: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:52:03.015317760Z [2024-02-23 02:52:03,015: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:52:03.015576339Z [2024-02-23 02:52:03,015: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:52:03.110525983Z [2024-02-23 02:52:03,110: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:52:03.113887649Z [2024-02-23 02:52:03,113: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:52:03.134591297Z [2024-02-23 02:52:03,134: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:52:03.136889598Z [2024-02-23 02:52:03,136: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:52:03.139899163Z [2024-02-23 02:52:03,139: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:52:03.140028816Z [2024-02-23 02:52:03,139: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:52:03.140244891Z [2024-02-23 02:52:03,139: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:52:03.140378470Z [2024-02-23 02:52:03,140: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:52:03.140632171Z [2024-02-23 02:52:03,140: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:52:03.140729441Z [2024-02-23 02:52:03,140: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:52:03.235163904Z [2024-02-23 02:52:03,234: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:52:05.557705981Z [2024-02-23 02:52:05,557: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[45ebf5b6-548a-498d-866b-4e1f6594c93f] succeeded in 4.756411279000531s: None 2024-02-23T02:52:06.481804338Z [2024-02-23 02:52:06,480: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a49a7cb-0141-443c-b3dd-998d156ad5f9] succeeded in 5.668220941999607s: None 2024-02-23T02:53:00.729674049Z [2024-02-23 02:53:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59526214-02f1-4d3d-9140-93c6b3c79da9] received 2024-02-23T02:53:00.741309922Z [2024-02-23 02:53:00,741: INFO/ForkPoolWorker-15] [59526214-02f1-4d3d-9140-93c6b3c79da9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:53:00.742654178Z [2024-02-23 02:53:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[894d3bed-1421-47f4-8f02-8038adfb7d34] received 2024-02-23T02:53:00.751353690Z [2024-02-23 02:53:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9834c5e6-4275-4400-a54e-21add29f2dee] received 2024-02-23T02:53:00.752678829Z [2024-02-23 02:53:00,752: INFO/ForkPoolWorker-16] [894d3bed-1421-47f4-8f02-8038adfb7d34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:53:00.758164075Z [2024-02-23 02:53:00,757: INFO/ForkPoolWorker-1] [9834c5e6-4275-4400-a54e-21add29f2dee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:53:01.056073765Z [2024-02-23 02:53:01,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:53:01.058583992Z [2024-02-23 02:53:01,055: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:53:01.128632095Z [2024-02-23 02:53:01,125: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:53:01.226122645Z [2024-02-23 02:53:01,225: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T02:53:01.230561237Z [2024-02-23 02:53:01,230: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:53:01.288805522Z [2024-02-23 02:53:01,288: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:53:01.290014734Z [2024-02-23 02:53:01,289: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:53:01.290123623Z [2024-02-23 02:53:01,289: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:53:01.290260580Z [2024-02-23 02:53:01,290: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T02:53:01.290547477Z [2024-02-23 02:53:01,290: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:53:01.411083873Z [2024-02-23 02:53:01,410: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:53:02.096350431Z [2024-02-23 02:53:02,095: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[894d3bed-1421-47f4-8f02-8038adfb7d34] succeeded in 1.3518961790014146s: None 2024-02-23T02:53:02.465918881Z [2024-02-23 02:53:02,465: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:53:02.469439903Z [2024-02-23 02:53:02,468: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:53:02.473374890Z [2024-02-23 02:53:02,472: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:53:02.477394789Z [2024-02-23 02:53:02,476: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:53:02.491570333Z [2024-02-23 02:53:02,491: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:53:02.492838047Z [2024-02-23 02:53:02,492: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:53:02.492851880Z [2024-02-23 02:53:02,492: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:53:02.492974006Z [2024-02-23 02:53:02,492: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:53:02.493072668Z [2024-02-23 02:53:02,492: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:53:02.493316083Z [2024-02-23 02:53:02,493: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:53:02.493403384Z [2024-02-23 02:53:02,493: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:53:02.504453289Z [2024-02-23 02:53:02,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:53:02.506141158Z [2024-02-23 02:53:02,505: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:53:02.506294831Z [2024-02-23 02:53:02,506: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:53:02.506567679Z [2024-02-23 02:53:02,506: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:53:02.506665576Z [2024-02-23 02:53:02,506: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:53:02.507119532Z [2024-02-23 02:53:02,506: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:53:02.507716552Z [2024-02-23 02:53:02,507: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:53:02.587443967Z [2024-02-23 02:53:02,587: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:53:02.636291828Z [2024-02-23 02:53:02,635: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:53:04.300642162Z [2024-02-23 02:53:04,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9834c5e6-4275-4400-a54e-21add29f2dee] succeeded in 3.547605906998797s: None 2024-02-23T02:53:04.818071201Z [2024-02-23 02:53:04,817: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59526214-02f1-4d3d-9140-93c6b3c79da9] succeeded in 4.085894735000693s: None 2024-02-23T02:54:00.677999678Z [2024-02-23 02:54:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ec0a6f8-8bb6-4f65-9a7d-5b02fe387b5a] received 2024-02-23T02:54:00.680273323Z [2024-02-23 02:54:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff079da0-417c-4c27-a9a6-66f49ab0b8d7] received 2024-02-23T02:54:00.683318734Z [2024-02-23 02:54:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e4630d2-7416-45cf-8314-2aa66763de42] received 2024-02-23T02:54:00.686181008Z [2024-02-23 02:54:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbdebc37-927c-431e-b2e4-15547c82a88a] received 2024-02-23T02:54:00.686987693Z [2024-02-23 02:54:00,686: INFO/ForkPoolWorker-16] [ff079da0-417c-4c27-a9a6-66f49ab0b8d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:54:00.693933256Z [2024-02-23 02:54:00,693: INFO/ForkPoolWorker-1] [0e4630d2-7416-45cf-8314-2aa66763de42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:54:00.694993343Z [2024-02-23 02:54:00,694: INFO/ForkPoolWorker-15] [1ec0a6f8-8bb6-4f65-9a7d-5b02fe387b5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:54:00.696669950Z [2024-02-23 02:54:00,696: INFO/ForkPoolWorker-2] [dbdebc37-927c-431e-b2e4-15547c82a88a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:54:01.037185575Z [2024-02-23 02:54:01,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:54:01.048372563Z [2024-02-23 02:54:01,045: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:54:01.118855870Z [2024-02-23 02:54:01,116: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:54:01.126995971Z [2024-02-23 02:54:01,105: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:54:01.369056212Z [2024-02-23 02:54:01,368: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:54:01.373166958Z [2024-02-23 02:54:01,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:54:01.377484805Z [2024-02-23 02:54:01,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:54:01.405239626Z [2024-02-23 02:54:01,405: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:54:01.406373572Z [2024-02-23 02:54:01,406: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:54:01.406426661Z [2024-02-23 02:54:01,406: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:54:01.406491913Z [2024-02-23 02:54:01,406: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:54:01.406686024Z [2024-02-23 02:54:01,406: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:54:01.504488880Z [2024-02-23 02:54:01,504: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:54:02.015643797Z [2024-02-23 02:54:02,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ec0a6f8-8bb6-4f65-9a7d-5b02fe387b5a] succeeded in 1.3356147020003846s: None 2024-02-23T02:54:02.183273356Z [2024-02-23 02:54:02,182: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0e4630d2-7416-45cf-8314-2aa66763de42] succeeded in 1.498330727999928s: None 2024-02-23T02:54:02.431035610Z [2024-02-23 02:54:02,430: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T02:54:02.437371424Z [2024-02-23 02:54:02,436: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:54:02.463361328Z [2024-02-23 02:54:02,463: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:54:02.465505210Z [2024-02-23 02:54:02,465: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:54:02.465752540Z [2024-02-23 02:54:02,465: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:54:02.466178157Z [2024-02-23 02:54:02,465: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:54:02.466341245Z [2024-02-23 02:54:02,466: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T02:54:02.466799301Z [2024-02-23 02:54:02,466: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:54:02.467120007Z [2024-02-23 02:54:02,466: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:54:02.532800157Z [2024-02-23 02:54:02,532: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:54:02.536299868Z [2024-02-23 02:54:02,535: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:54:02.568750582Z [2024-02-23 02:54:02,568: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:54:02.572379219Z [2024-02-23 02:54:02,572: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:54:02.572399239Z [2024-02-23 02:54:02,572: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:54:02.572522579Z [2024-02-23 02:54:02,572: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:54:02.572603402Z [2024-02-23 02:54:02,572: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:54:02.572878687Z [2024-02-23 02:54:02,572: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:54:02.572915436Z [2024-02-23 02:54:02,572: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:54:02.581006536Z [2024-02-23 02:54:02,580: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:54:02.673908260Z [2024-02-23 02:54:02,673: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:54:04.118581954Z [2024-02-23 02:54:04,118: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff079da0-417c-4c27-a9a6-66f49ab0b8d7] succeeded in 3.43673616399974s: None 2024-02-23T02:54:04.475888310Z [2024-02-23 02:54:04,475: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dbdebc37-927c-431e-b2e4-15547c82a88a] succeeded in 3.7873853820001386s: None 2024-02-23T02:55:00.682963116Z [2024-02-23 02:55:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c495f9aa-c865-4d12-89ce-8b173eda1b64] received 2024-02-23T02:55:00.682993596Z [2024-02-23 02:55:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7906f35d-f53e-41ba-ab7a-012d3a8ef65f] received 2024-02-23T02:55:00.687609448Z [2024-02-23 02:55:00,687: INFO/ForkPoolWorker-15] [c495f9aa-c865-4d12-89ce-8b173eda1b64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:55:00.696163752Z [2024-02-23 02:55:00,694: INFO/ForkPoolWorker-16] [7906f35d-f53e-41ba-ab7a-012d3a8ef65f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:55:00.711215554Z [2024-02-23 02:55:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c85ee74c-aa2c-4c2d-9075-d461b78656ef] received 2024-02-23T02:55:00.733195838Z [2024-02-23 02:55:00,732: INFO/ForkPoolWorker-1] [c85ee74c-aa2c-4c2d-9075-d461b78656ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:55:00.737891367Z [2024-02-23 02:55:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cd74880-ff66-4e20-a60d-05d2f990558c] received 2024-02-23T02:55:00.750411968Z [2024-02-23 02:55:00,749: INFO/ForkPoolWorker-2] [9cd74880-ff66-4e20-a60d-05d2f990558c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:55:01.186908591Z [2024-02-23 02:55:01,183: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:55:01.202647809Z [2024-02-23 02:55:01,196: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:55:01.256849103Z [2024-02-23 02:55:01,253: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:55:01.359188228Z [2024-02-23 02:55:01,349: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:55:01.569567798Z [2024-02-23 02:55:01,569: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:55:01.575069589Z [2024-02-23 02:55:01,574: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:01.624035064Z [2024-02-23 02:55:01,623: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:55:01.628010373Z [2024-02-23 02:55:01,627: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:55:01.628092719Z [2024-02-23 02:55:01,627: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:55:01.628175285Z [2024-02-23 02:55:01,628: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:55:01.628415217Z [2024-02-23 02:55:01,628: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:55:01.769366843Z [2024-02-23 02:55:01,768: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:02.852165781Z [2024-02-23 02:55:02,851: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9cd74880-ff66-4e20-a60d-05d2f990558c] succeeded in 2.1126106860010623s: None 2024-02-23T02:55:03.100379735Z [2024-02-23 02:55:03,099: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:55:03.103929065Z [2024-02-23 02:55:03,103: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:03.132530221Z [2024-02-23 02:55:03,132: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:55:03.133979303Z [2024-02-23 02:55:03,133: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:55:03.134043166Z [2024-02-23 02:55:03,133: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:55:03.134263545Z [2024-02-23 02:55:03,134: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:55:03.134352278Z [2024-02-23 02:55:03,134: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:55:03.134681307Z [2024-02-23 02:55:03,134: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:55:03.135022427Z [2024-02-23 02:55:03,134: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:55:03.235808064Z [2024-02-23 02:55:03,235: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:03.320282757Z [2024-02-23 02:55:03,319: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:55:03.325579439Z [2024-02-23 02:55:03,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:03.366600760Z [2024-02-23 02:55:03,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:55:03.368229942Z [2024-02-23 02:55:03,367: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:55:03.368362401Z [2024-02-23 02:55:03,368: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:55:03.368699041Z [2024-02-23 02:55:03,368: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:55:03.368932777Z [2024-02-23 02:55:03,368: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:55:03.369479683Z [2024-02-23 02:55:03,369: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:55:03.369787478Z [2024-02-23 02:55:03,369: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:55:03.397676995Z [2024-02-23 02:55:03,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:55:03.401150351Z [2024-02-23 02:55:03,400: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:03.427262944Z [2024-02-23 02:55:03,426: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:55:03.429711411Z [2024-02-23 02:55:03,429: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:55:03.430025149Z [2024-02-23 02:55:03,429: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:55:03.430337627Z [2024-02-23 02:55:03,430: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:55:03.430535081Z [2024-02-23 02:55:03,430: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:55:03.431526870Z [2024-02-23 02:55:03,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:55:03.431700504Z [2024-02-23 02:55:03,431: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:55:03.613517936Z [2024-02-23 02:55:03,613: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:03.649078493Z [2024-02-23 02:55:03,648: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:04.479905079Z [2024-02-23 02:55:04,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c495f9aa-c865-4d12-89ce-8b173eda1b64] succeeded in 3.79997654699946s: None 2024-02-23T02:55:04.783469328Z [2024-02-23 02:55:04,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84b2eeb5-42ee-47e9-901c-3b60afbed6f2] received 2024-02-23T02:55:04.794424355Z [2024-02-23 02:55:04,794: INFO/ForkPoolWorker-15] [84b2eeb5-42ee-47e9-901c-3b60afbed6f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:55:05.092273888Z [2024-02-23 02:55:05,089: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:55:05.498953422Z [2024-02-23 02:55:05,491: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c85ee74c-aa2c-4c2d-9075-d461b78656ef] succeeded in 4.779766113999358s: None 2024-02-23T02:55:05.910297618Z [2024-02-23 02:55:05,909: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7906f35d-f53e-41ba-ab7a-012d3a8ef65f] succeeded in 5.225923414998761s: None 2024-02-23T02:55:06.806877634Z [2024-02-23 02:55:06,806: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:55:06.810293299Z [2024-02-23 02:55:06,809: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:06.831399996Z [2024-02-23 02:55:06,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:55:06.832849096Z [2024-02-23 02:55:06,832: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:55:06.833103497Z [2024-02-23 02:55:06,832: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:55:06.833387856Z [2024-02-23 02:55:06,833: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:55:06.833656816Z [2024-02-23 02:55:06,833: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:55:06.834016572Z [2024-02-23 02:55:06,833: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:55:06.834153189Z [2024-02-23 02:55:06,834: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:55:06.925934327Z [2024-02-23 02:55:06,925: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:07.711819681Z [2024-02-23 02:55:07,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84b2eeb5-42ee-47e9-901c-3b60afbed6f2] succeeded in 2.924250132000452s: None 2024-02-23T02:55:08.362664922Z [2024-02-23 02:55:08,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a68a90ad-dd33-425b-8df4-dc8b013476d8] received 2024-02-23T02:55:08.373870824Z [2024-02-23 02:55:08,373: INFO/ForkPoolWorker-15] [a68a90ad-dd33-425b-8df4-dc8b013476d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T02:55:08.736712611Z [2024-02-23 02:55:08,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:55:10.121819081Z [2024-02-23 02:55:10,121: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:55:10.125180957Z [2024-02-23 02:55:10,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:10.144322296Z [2024-02-23 02:55:10,144: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:55:10.145624743Z [2024-02-23 02:55:10,145: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:55:10.145643617Z [2024-02-23 02:55:10,145: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:55:10.145751387Z [2024-02-23 02:55:10,145: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:55:10.145893873Z [2024-02-23 02:55:10,145: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:55:10.146183441Z [2024-02-23 02:55:10,146: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:55:10.146234264Z [2024-02-23 02:55:10,146: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:55:10.233046072Z [2024-02-23 02:55:10,232: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:10.732668614Z [2024-02-23 02:55:10,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[716ea448-65a0-41eb-8098-acbc2a4fe1dd] received 2024-02-23T02:55:10.786584606Z [2024-02-23 02:55:10,783: INFO/ForkPoolWorker-16] [716ea448-65a0-41eb-8098-acbc2a4fe1dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T02:55:10.790148193Z [2024-02-23 02:55:10,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a68a90ad-dd33-425b-8df4-dc8b013476d8] succeeded in 2.424826088001282s: None 2024-02-23T02:55:11.081553860Z [2024-02-23 02:55:11,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T02:55:12.282565897Z [2024-02-23 02:55:12,282: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:55:12.287677125Z [2024-02-23 02:55:12,287: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:55:12.338388845Z [2024-02-23 02:55:12,338: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:55:12.343589204Z [2024-02-23 02:55:12,343: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:55:12.343610275Z [2024-02-23 02:55:12,343: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:55:12.343679226Z [2024-02-23 02:55:12,343: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:55:12.343789764Z [2024-02-23 02:55:12,343: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:55:12.344089751Z [2024-02-23 02:55:12,343: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T02:55:12.344100246Z [2024-02-23 02:55:12,344: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:55:12.562504891Z [2024-02-23 02:55:12,562: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:55:13.374159167Z [2024-02-23 02:55:13,373: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[716ea448-65a0-41eb-8098-acbc2a4fe1dd] succeeded in 2.6362650350001786s: None 2024-02-23T02:56:01.103940097Z [2024-02-23 02:56:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a0105b4-59a3-4fd4-90e1-155b9920cbcb] received 2024-02-23T02:56:01.110667582Z [2024-02-23 02:56:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4dfe45f-235e-4199-8eb9-36378fa6ab6c] received 2024-02-23T02:56:01.116684741Z [2024-02-23 02:56:01,116: INFO/ForkPoolWorker-15] [4a0105b4-59a3-4fd4-90e1-155b9920cbcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:56:01.122106500Z [2024-02-23 02:56:01,121: INFO/ForkPoolWorker-16] [c4dfe45f-235e-4199-8eb9-36378fa6ab6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:56:01.127970839Z [2024-02-23 02:56:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82736e1a-36ec-4996-837e-6b00f39f734d] received 2024-02-23T02:56:01.134338804Z [2024-02-23 02:56:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb9a16ca-692e-48a9-bb6b-aad6931bd952] received 2024-02-23T02:56:01.144970871Z [2024-02-23 02:56:01,144: INFO/ForkPoolWorker-2] [cb9a16ca-692e-48a9-bb6b-aad6931bd952] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:56:01.152322774Z [2024-02-23 02:56:01,151: INFO/ForkPoolWorker-1] [82736e1a-36ec-4996-837e-6b00f39f734d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:56:01.462767929Z [2024-02-23 02:56:01,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:56:01.585509346Z [2024-02-23 02:56:01,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:56:01.670454648Z [2024-02-23 02:56:01,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:56:01.685298270Z [2024-02-23 02:56:01,682: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:56:01.762520717Z [2024-02-23 02:56:01,762: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:56:01.961207832Z [2024-02-23 02:56:01,960: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:56:01.969492257Z [2024-02-23 02:56:01,968: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:56:02.019776238Z [2024-02-23 02:56:02,019: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:56:02.022320271Z [2024-02-23 02:56:02,021: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:56:02.022556968Z [2024-02-23 02:56:02,022: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:56:02.022817570Z [2024-02-23 02:56:02,022: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:56:02.023307332Z [2024-02-23 02:56:02,023: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:56:02.178002076Z [2024-02-23 02:56:02,177: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:56:02.513998173Z [2024-02-23 02:56:02,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a0105b4-59a3-4fd4-90e1-155b9920cbcb] succeeded in 1.4065779709999333s: None 2024-02-23T02:56:02.893856807Z [2024-02-23 02:56:02,893: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb9a16ca-692e-48a9-bb6b-aad6931bd952] succeeded in 1.7576721540008293s: None 2024-02-23T02:56:03.088227412Z [2024-02-23 02:56:03,087: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:56:03.091965714Z [2024-02-23 02:56:03,091: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:56:03.122845755Z [2024-02-23 02:56:03,122: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:56:03.128018147Z [2024-02-23 02:56:03,127: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:56:03.128242659Z [2024-02-23 02:56:03,128: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:56:03.128453089Z [2024-02-23 02:56:03,128: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:56:03.128607085Z [2024-02-23 02:56:03,128: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:56:03.128965143Z [2024-02-23 02:56:03,128: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:56:03.129177996Z [2024-02-23 02:56:03,129: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:56:03.213043616Z [2024-02-23 02:56:03,212: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:56:03.216484491Z [2024-02-23 02:56:03,216: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:56:03.239460306Z [2024-02-23 02:56:03,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:56:03.247106905Z [2024-02-23 02:56:03,246: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:56:03.248795990Z [2024-02-23 02:56:03,248: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:56:03.249021018Z [2024-02-23 02:56:03,248: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:56:03.249542983Z [2024-02-23 02:56:03,249: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:56:03.249736453Z [2024-02-23 02:56:03,249: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:56:03.250355103Z [2024-02-23 02:56:03,250: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:56:03.250575731Z [2024-02-23 02:56:03,250: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:56:03.388293993Z [2024-02-23 02:56:03,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:56:05.759276900Z [2024-02-23 02:56:05,758: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[82736e1a-36ec-4996-837e-6b00f39f734d] succeeded in 4.625367770000594s: None 2024-02-23T02:56:06.103857729Z [2024-02-23 02:56:06,103: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4dfe45f-235e-4199-8eb9-36378fa6ab6c] succeeded in 4.989621429000181s: None 2024-02-23T02:57:00.799355510Z [2024-02-23 02:57:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[594ce8b8-ecf8-4c8e-b6f7-67eb9baf1a65] received 2024-02-23T02:57:00.801695894Z [2024-02-23 02:57:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32fa7827-10e0-4a0a-9ba1-02fc4f0be1a8] received 2024-02-23T02:57:00.808360372Z [2024-02-23 02:57:00,807: INFO/ForkPoolWorker-15] [594ce8b8-ecf8-4c8e-b6f7-67eb9baf1a65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:57:00.808926487Z [2024-02-23 02:57:00,808: INFO/ForkPoolWorker-16] [32fa7827-10e0-4a0a-9ba1-02fc4f0be1a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:57:00.819928820Z [2024-02-23 02:57:00,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec4307a1-c192-44c4-a763-97bd8351cb88] received 2024-02-23T02:57:00.839091580Z [2024-02-23 02:57:00,838: INFO/ForkPoolWorker-1] [ec4307a1-c192-44c4-a763-97bd8351cb88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:57:01.122041875Z [2024-02-23 02:57:01,117: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:57:01.160446137Z [2024-02-23 02:57:01,157: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:57:01.178510348Z [2024-02-23 02:57:01,175: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:57:01.324295543Z [2024-02-23 02:57:01,323: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:57:01.331738805Z [2024-02-23 02:57:01,331: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:57:01.357465960Z [2024-02-23 02:57:01,357: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:57:01.360408335Z [2024-02-23 02:57:01,360: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:57:01.360873112Z [2024-02-23 02:57:01,360: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:57:01.361267339Z [2024-02-23 02:57:01,360: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:57:01.362012199Z [2024-02-23 02:57:01,361: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:57:01.496137614Z [2024-02-23 02:57:01,495: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:57:02.162756338Z [2024-02-23 02:57:02,162: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec4307a1-c192-44c4-a763-97bd8351cb88] succeeded in 1.3406010270009574s: None 2024-02-23T02:57:02.353009140Z [2024-02-23 02:57:02,352: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:57:02.357129556Z [2024-02-23 02:57:02,356: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:57:02.377732084Z [2024-02-23 02:57:02,377: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:57:02.381402780Z [2024-02-23 02:57:02,381: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:57:02.381697357Z [2024-02-23 02:57:02,381: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:57:02.383472443Z [2024-02-23 02:57:02,383: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:57:02.383717195Z [2024-02-23 02:57:02,383: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:57:02.384055990Z [2024-02-23 02:57:02,383: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:57:02.384219848Z [2024-02-23 02:57:02,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:57:02.384598948Z [2024-02-23 02:57:02,384: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:57:02.384817082Z [2024-02-23 02:57:02,384: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:57:02.409894878Z [2024-02-23 02:57:02,409: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:57:02.411267670Z [2024-02-23 02:57:02,410: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:57:02.411331005Z [2024-02-23 02:57:02,411: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:57:02.411413236Z [2024-02-23 02:57:02,411: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:57:02.411420568Z [2024-02-23 02:57:02,411: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:57:02.411767561Z [2024-02-23 02:57:02,411: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:57:02.411871657Z [2024-02-23 02:57:02,411: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:57:02.476490835Z [2024-02-23 02:57:02,476: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:57:02.501102980Z [2024-02-23 02:57:02,500: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:57:04.115765101Z [2024-02-23 02:57:04,115: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32fa7827-10e0-4a0a-9ba1-02fc4f0be1a8] succeeded in 3.3116923950001365s: None 2024-02-23T02:57:04.476037176Z [2024-02-23 02:57:04,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[594ce8b8-ecf8-4c8e-b6f7-67eb9baf1a65] succeeded in 3.6735043059998134s: None 2024-02-23T02:58:00.767709169Z [2024-02-23 02:58:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b881656-8686-4f60-926e-b2453bfb7fc9] received 2024-02-23T02:58:00.769240776Z [2024-02-23 02:58:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[009b357a-48e6-4564-844d-907c05b3e888] received 2024-02-23T02:58:00.773654817Z [2024-02-23 02:58:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a65018f-4228-425e-8a7d-7ff7912f102c] received 2024-02-23T02:58:00.777201544Z [2024-02-23 02:58:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[409f0bfa-53c3-487e-a961-e46f32c6acc5] received 2024-02-23T02:58:00.786231485Z [2024-02-23 02:58:00,785: INFO/ForkPoolWorker-15] [2b881656-8686-4f60-926e-b2453bfb7fc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:58:00.789787636Z [2024-02-23 02:58:00,789: INFO/ForkPoolWorker-2] [409f0bfa-53c3-487e-a961-e46f32c6acc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:58:00.792700115Z [2024-02-23 02:58:00,792: INFO/ForkPoolWorker-1] [6a65018f-4228-425e-8a7d-7ff7912f102c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:58:00.793331933Z [2024-02-23 02:58:00,793: INFO/ForkPoolWorker-16] [009b357a-48e6-4564-844d-907c05b3e888] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T02:58:01.192010123Z [2024-02-23 02:58:01,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:58:01.208557342Z [2024-02-23 02:58:01,205: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:58:01.247577222Z [2024-02-23 02:58:01,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:58:01.322635901Z [2024-02-23 02:58:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T02:58:01.402278824Z [2024-02-23 02:58:01,401: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T02:58:01.406346435Z [2024-02-23 02:58:01,405: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:58:01.432004160Z [2024-02-23 02:58:01,431: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T02:58:01.435737545Z [2024-02-23 02:58:01,435: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:58:01.435907604Z [2024-02-23 02:58:01,435: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:58:01.436023018Z [2024-02-23 02:58:01,435: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T02:58:01.436295215Z [2024-02-23 02:58:01,436: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:58:01.527388436Z [2024-02-23 02:58:01,527: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:58:01.601272186Z [2024-02-23 02:58:01,600: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:58:02.090570970Z [2024-02-23 02:58:02,090: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[409f0bfa-53c3-487e-a961-e46f32c6acc5] succeeded in 1.3110018669995043s: None 2024-02-23T02:58:02.332164213Z [2024-02-23 02:58:02,331: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[009b357a-48e6-4564-844d-907c05b3e888] succeeded in 1.5601515599992126s: None 2024-02-23T02:58:02.550895253Z [2024-02-23 02:58:02,550: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T02:58:02.554290543Z [2024-02-23 02:58:02,553: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:58:02.576374260Z [2024-02-23 02:58:02,576: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:58:02.577787472Z [2024-02-23 02:58:02,577: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:58:02.577800718Z [2024-02-23 02:58:02,577: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:58:02.578053095Z [2024-02-23 02:58:02,577: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:58:02.578134893Z [2024-02-23 02:58:02,578: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T02:58:02.579381405Z [2024-02-23 02:58:02,579: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:58:02.579393184Z [2024-02-23 02:58:02,579: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:58:02.598680332Z [2024-02-23 02:58:02,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:58:02.602282484Z [2024-02-23 02:58:02,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:58:02.625396901Z [2024-02-23 02:58:02,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:58:02.629348990Z [2024-02-23 02:58:02,628: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:58:02.629810622Z [2024-02-23 02:58:02,629: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:58:02.630164846Z [2024-02-23 02:58:02,629: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:58:02.630346646Z [2024-02-23 02:58:02,630: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:58:02.630886402Z [2024-02-23 02:58:02,630: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:58:02.631153275Z [2024-02-23 02:58:02,630: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:58:02.682132056Z [2024-02-23 02:58:02,681: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:58:02.718975586Z [2024-02-23 02:58:02,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:58:04.488509007Z [2024-02-23 02:58:04,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b881656-8686-4f60-926e-b2453bfb7fc9] succeeded in 3.7178056049997394s: None 2024-02-23T02:58:05.434304069Z [2024-02-23 02:58:05,433: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a65018f-4228-425e-8a7d-7ff7912f102c] succeeded in 4.657703652001146s: None 2024-02-23T02:59:00.287670433Z [2024-02-23 02:59:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[680aae4b-b409-4556-888a-86dab6054ede] received 2024-02-23T02:59:00.289411465Z [2024-02-23 02:59:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae316434-ff2a-412d-8a58-184788c277fb] received 2024-02-23T02:59:00.296268831Z [2024-02-23 02:59:00,296: INFO/ForkPoolWorker-16] [ae316434-ff2a-412d-8a58-184788c277fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T02:59:00.298001307Z [2024-02-23 02:59:00,297: INFO/ForkPoolWorker-15] [680aae4b-b409-4556-888a-86dab6054ede] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T02:59:00.299493402Z [2024-02-23 02:59:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[832f57fa-237f-449b-a633-3d92bdca4f29] received 2024-02-23T02:59:00.310939192Z [2024-02-23 02:59:00,310: INFO/ForkPoolWorker-1] [832f57fa-237f-449b-a633-3d92bdca4f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T02:59:00.589114230Z [2024-02-23 02:59:00,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T02:59:00.589175272Z [2024-02-23 02:59:00,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T02:59:00.611614775Z [2024-02-23 02:59:00,608: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T02:59:00.770424630Z [2024-02-23 02:59:00,769: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T02:59:00.774398541Z [2024-02-23 02:59:00,773: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:59:00.799765124Z [2024-02-23 02:59:00,799: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T02:59:00.801542766Z [2024-02-23 02:59:00,801: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T02:59:00.801892244Z [2024-02-23 02:59:00,801: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T02:59:00.802267701Z [2024-02-23 02:59:00,801: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T02:59:00.802602043Z [2024-02-23 02:59:00,802: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T02:59:00.935330925Z [2024-02-23 02:59:00,935: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:59:01.567623186Z [2024-02-23 02:59:01,567: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[832f57fa-237f-449b-a633-3d92bdca4f29] succeeded in 1.2647578960004466s: None 2024-02-23T02:59:01.667183733Z [2024-02-23 02:59:01,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T02:59:01.669581086Z [2024-02-23 02:59:01,669: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T02:59:01.670434733Z [2024-02-23 02:59:01,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:59:01.672818774Z [2024-02-23 02:59:01,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T02:59:01.689263332Z [2024-02-23 02:59:01,689: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T02:59:01.692883518Z [2024-02-23 02:59:01,692: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:59:01.692928093Z [2024-02-23 02:59:01,692: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:59:01.693003709Z [2024-02-23 02:59:01,692: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:59:01.693016339Z [2024-02-23 02:59:01,692: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T02:59:01.693296830Z [2024-02-23 02:59:01,693: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T02:59:01.693305490Z [2024-02-23 02:59:01,693: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:59:01.695809790Z [2024-02-23 02:59:01,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T02:59:01.700086121Z [2024-02-23 02:59:01,699: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T02:59:01.700121322Z [2024-02-23 02:59:01,700: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T02:59:01.700302997Z [2024-02-23 02:59:01,700: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T02:59:01.700346810Z [2024-02-23 02:59:01,700: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T02:59:01.700633521Z [2024-02-23 02:59:01,700: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T02:59:01.700689473Z [2024-02-23 02:59:01,700: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T02:59:01.777294464Z [2024-02-23 02:59:01,776: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:59:01.777432063Z [2024-02-23 02:59:01,777: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T02:59:03.274631577Z [2024-02-23 02:59:03,274: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[680aae4b-b409-4556-888a-86dab6054ede] succeeded in 2.98392689100001s: None 2024-02-23T02:59:04.178571922Z [2024-02-23 02:59:04,178: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae316434-ff2a-412d-8a58-184788c277fb] succeeded in 3.887992599999052s: None 2024-02-23T03:00:00.776772545Z [2024-02-23 03:00:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[142ce6f3-b183-46ac-9f5e-17d43a792eb5] received 2024-02-23T03:00:00.786081833Z [2024-02-23 03:00:00,785: INFO/ForkPoolWorker-15] [142ce6f3-b183-46ac-9f5e-17d43a792eb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:00:00.790701357Z [2024-02-23 03:00:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b58a216f-101b-4f94-8859-d05b079c65a6] received 2024-02-23T03:00:00.793900567Z [2024-02-23 03:00:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5edede06-d14d-4913-9a76-a774922b83af] received 2024-02-23T03:00:00.795057927Z [2024-02-23 03:00:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72b6db30-3fee-482b-ad83-23d6cfd0ae1d] received 2024-02-23T03:00:00.796653958Z [2024-02-23 03:00:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ab13938-61c0-4852-aea8-f2ff5b5c4776] received 2024-02-23T03:00:00.806627593Z [2024-02-23 03:00:00,806: INFO/ForkPoolWorker-3] [3ab13938-61c0-4852-aea8-f2ff5b5c4776] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:00:00.822297516Z [2024-02-23 03:00:00,822: INFO/ForkPoolWorker-1] [5edede06-d14d-4913-9a76-a774922b83af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:00:00.828937813Z [2024-02-23 03:00:00,828: INFO/ForkPoolWorker-2] [72b6db30-3fee-482b-ad83-23d6cfd0ae1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:00:00.860621107Z [2024-02-23 03:00:00,860: INFO/ForkPoolWorker-16] [b58a216f-101b-4f94-8859-d05b079c65a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:00:01.228345966Z [2024-02-23 03:00:01,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:00:01.350705835Z [2024-02-23 03:00:01,343: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:00:01.352912235Z [2024-02-23 03:00:01,348: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:00:01.680321060Z [2024-02-23 03:00:01,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:00:01.712225908Z [2024-02-23 03:00:01,708: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:00:01.937346039Z [2024-02-23 03:00:01,936: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T03:00:01.941791367Z [2024-02-23 03:00:01,941: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:01.993944804Z [2024-02-23 03:00:01,993: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:00:01.995949533Z [2024-02-23 03:00:01,995: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:00:01.996215484Z [2024-02-23 03:00:01,995: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:00:01.996381448Z [2024-02-23 03:00:01,996: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T03:00:01.996775908Z [2024-02-23 03:00:01,996: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:00:02.017045435Z [2024-02-23 03:00:02,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:02.112586134Z [2024-02-23 03:00:02,112: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:02.743122783Z [2024-02-23 03:00:02,742: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b58a216f-101b-4f94-8859-d05b079c65a6] succeeded in 1.9450579679996736s: None 2024-02-23T03:00:02.772854008Z [2024-02-23 03:00:02,772: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3ab13938-61c0-4852-aea8-f2ff5b5c4776] succeeded in 1.9739670769995428s: None 2024-02-23T03:00:02.883812798Z [2024-02-23 03:00:02,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:00:02.887333287Z [2024-02-23 03:00:02,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:02.924777187Z [2024-02-23 03:00:02,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:00:02.929043170Z [2024-02-23 03:00:02,928: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:00:02.929560723Z [2024-02-23 03:00:02,929: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:00:02.929832089Z [2024-02-23 03:00:02,929: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:00:02.929945544Z [2024-02-23 03:00:02,929: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:00:02.930690565Z [2024-02-23 03:00:02,930: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:00:02.930837180Z [2024-02-23 03:00:02,930: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:00:03.028105170Z [2024-02-23 03:00:03,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:03.174212051Z [2024-02-23 03:00:03,173: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:00:03.177491136Z [2024-02-23 03:00:03,177: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:03.215569813Z [2024-02-23 03:00:03,215: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:00:03.217866825Z [2024-02-23 03:00:03,217: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:00:03.217885390Z [2024-02-23 03:00:03,217: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:00:03.217960940Z [2024-02-23 03:00:03,217: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:00:03.218003805Z [2024-02-23 03:00:03,217: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:00:03.218338427Z [2024-02-23 03:00:03,218: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:00:03.218417528Z [2024-02-23 03:00:03,218: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:00:03.313082639Z [2024-02-23 03:00:03,312: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:03.449271503Z [2024-02-23 03:00:03,448: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:00:03.452859941Z [2024-02-23 03:00:03,452: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:03.495458661Z [2024-02-23 03:00:03,495: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:00:03.497360116Z [2024-02-23 03:00:03,497: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:00:03.497618439Z [2024-02-23 03:00:03,497: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:00:03.498318174Z [2024-02-23 03:00:03,498: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:00:03.498403859Z [2024-02-23 03:00:03,498: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:00:03.498669540Z [2024-02-23 03:00:03,498: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:00:03.498757823Z [2024-02-23 03:00:03,498: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:00:03.603559412Z [2024-02-23 03:00:03,603: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:03.638189577Z [2024-02-23 03:00:03,637: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[142ce6f3-b183-46ac-9f5e-17d43a792eb5] succeeded in 2.8578721690009843s: None 2024-02-23T03:00:04.223282161Z [2024-02-23 03:00:04,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[697d4e6e-74ae-4cb7-801c-28435c3d953f] received 2024-02-23T03:00:04.231451598Z [2024-02-23 03:00:04,231: INFO/ForkPoolWorker-15] [697d4e6e-74ae-4cb7-801c-28435c3d953f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:00:04.523975561Z [2024-02-23 03:00:04,520: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:00:05.722755196Z [2024-02-23 03:00:05,722: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:00:05.726124532Z [2024-02-23 03:00:05,725: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:05.751465580Z [2024-02-23 03:00:05,751: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:00:05.752970967Z [2024-02-23 03:00:05,752: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:00:05.753165864Z [2024-02-23 03:00:05,752: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:00:05.753955222Z [2024-02-23 03:00:05,753: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:00:05.754158522Z [2024-02-23 03:00:05,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:00:05.754660716Z [2024-02-23 03:00:05,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:00:05.754850462Z [2024-02-23 03:00:05,754: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:00:05.817492745Z [2024-02-23 03:00:05,816: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[72b6db30-3fee-482b-ad83-23d6cfd0ae1d] succeeded in 5.017416234000848s: None 2024-02-23T03:00:05.865229569Z [2024-02-23 03:00:05,864: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:06.170011119Z [2024-02-23 03:00:06,169: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5edede06-d14d-4913-9a76-a774922b83af] succeeded in 5.373854523999398s: None 2024-02-23T03:00:06.569049340Z [2024-02-23 03:00:06,568: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[697d4e6e-74ae-4cb7-801c-28435c3d953f] succeeded in 2.3437359500003367s: None 2024-02-23T03:00:06.681151969Z [2024-02-23 03:00:06,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9adee83a-08e5-4a7d-944d-428125a9515e] received 2024-02-23T03:00:06.693967293Z [2024-02-23 03:00:06,693: INFO/ForkPoolWorker-15] [9adee83a-08e5-4a7d-944d-428125a9515e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:00:06.999737890Z [2024-02-23 03:00:06,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:00:08.229205724Z [2024-02-23 03:00:08,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:00:08.232575142Z [2024-02-23 03:00:08,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:08.257191884Z [2024-02-23 03:00:08,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:00:08.258930319Z [2024-02-23 03:00:08,258: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:00:08.259023686Z [2024-02-23 03:00:08,258: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:00:08.259309451Z [2024-02-23 03:00:08,259: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:00:08.259433475Z [2024-02-23 03:00:08,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:00:08.259772585Z [2024-02-23 03:00:08,259: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:00:08.259815255Z [2024-02-23 03:00:08,259: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:00:08.343553959Z [2024-02-23 03:00:08,343: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:08.878402889Z [2024-02-23 03:00:08,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9adee83a-08e5-4a7d-944d-428125a9515e] succeeded in 2.195219465000264s: None 2024-02-23T03:00:09.347323331Z [2024-02-23 03:00:09,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b80f778-0c75-4d87-b896-cfd6cea5ef57] received 2024-02-23T03:00:09.354152105Z [2024-02-23 03:00:09,353: INFO/ForkPoolWorker-15] [6b80f778-0c75-4d87-b896-cfd6cea5ef57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:00:09.685196132Z [2024-02-23 03:00:09,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:00:10.847214052Z [2024-02-23 03:00:10,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:00:10.852060132Z [2024-02-23 03:00:10,851: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:00:10.868372725Z [2024-02-23 03:00:10,868: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:00:10.869539384Z [2024-02-23 03:00:10,869: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:00:10.869639301Z [2024-02-23 03:00:10,869: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:00:10.869783804Z [2024-02-23 03:00:10,869: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:00:10.869862410Z [2024-02-23 03:00:10,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:00:10.870139521Z [2024-02-23 03:00:10,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:00:10.870245411Z [2024-02-23 03:00:10,870: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:00:10.955904875Z [2024-02-23 03:00:10,955: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:00:11.510112221Z [2024-02-23 03:00:11,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b80f778-0c75-4d87-b896-cfd6cea5ef57] succeeded in 2.16089645700049s: None 2024-02-23T03:01:00.930656834Z [2024-02-23 03:01:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b206738a-4d83-4d23-b644-59b614271ab4] received 2024-02-23T03:01:00.933588097Z [2024-02-23 03:01:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49b4de57-4fa8-4e36-b22a-d5090a77ddd1] received 2024-02-23T03:01:00.937710948Z [2024-02-23 03:01:00,937: INFO/ForkPoolWorker-15] [b206738a-4d83-4d23-b644-59b614271ab4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:01:00.940209927Z [2024-02-23 03:01:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f0afb63-d56c-4d66-b2a4-0669a3c77354] received 2024-02-23T03:01:00.948416219Z [2024-02-23 03:01:00,948: INFO/ForkPoolWorker-1] [5f0afb63-d56c-4d66-b2a4-0669a3c77354] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:01:00.949781840Z [2024-02-23 03:01:00,949: INFO/ForkPoolWorker-16] [49b4de57-4fa8-4e36-b22a-d5090a77ddd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:01:01.259631584Z [2024-02-23 03:01:01,256: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:01:01.290728542Z [2024-02-23 03:01:01,287: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:01:01.303394784Z [2024-02-23 03:01:01,300: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:01:01.470591154Z [2024-02-23 03:01:01,470: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:01:01.478135407Z [2024-02-23 03:01:01,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:01:01.509467126Z [2024-02-23 03:01:01,508: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:01:01.510751871Z [2024-02-23 03:01:01,509: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:01:01.510767789Z [2024-02-23 03:01:01,509: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:01:01.510772200Z [2024-02-23 03:01:01,509: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:01:01.510775621Z [2024-02-23 03:01:01,510: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:01:01.670462453Z [2024-02-23 03:01:01,670: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:01:02.328393690Z [2024-02-23 03:01:02,327: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f0afb63-d56c-4d66-b2a4-0669a3c77354] succeeded in 1.3856031010000152s: None 2024-02-23T03:01:02.594464295Z [2024-02-23 03:01:02,594: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:01:02.598248468Z [2024-02-23 03:01:02,597: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:01:02.625359324Z [2024-02-23 03:01:02,625: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:01:02.627304494Z [2024-02-23 03:01:02,627: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:01:02.627459496Z [2024-02-23 03:01:02,627: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:01:02.627668743Z [2024-02-23 03:01:02,627: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:01:02.627797101Z [2024-02-23 03:01:02,627: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:01:02.628403176Z [2024-02-23 03:01:02,628: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:01:02.628539833Z [2024-02-23 03:01:02,628: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:01:02.660148881Z [2024-02-23 03:01:02,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:01:02.663512584Z [2024-02-23 03:01:02,663: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:01:02.693526639Z [2024-02-23 03:01:02,693: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:01:02.694916312Z [2024-02-23 03:01:02,694: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:01:02.695022566Z [2024-02-23 03:01:02,694: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:01:02.695185136Z [2024-02-23 03:01:02,694: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:01:02.695249241Z [2024-02-23 03:01:02,695: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:01:02.695689834Z [2024-02-23 03:01:02,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:01:02.695742931Z [2024-02-23 03:01:02,695: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:01:02.735536005Z [2024-02-23 03:01:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:01:02.835112253Z [2024-02-23 03:01:02,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:01:05.301849387Z [2024-02-23 03:01:05,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b206738a-4d83-4d23-b644-59b614271ab4] succeeded in 4.368479405000471s: None 2024-02-23T03:01:05.713812845Z [2024-02-23 03:01:05,713: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[49b4de57-4fa8-4e36-b22a-d5090a77ddd1] succeeded in 4.774428454000372s: None 2024-02-23T03:02:01.230976843Z [2024-02-23 03:02:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ec2fde8-a157-4a99-b1f8-6a36982d4f9c] received 2024-02-23T03:02:01.236715063Z [2024-02-23 03:02:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[945228f6-aa23-448e-b56d-eb87bee8db44] received 2024-02-23T03:02:01.239440960Z [2024-02-23 03:02:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d0a6088-3e59-4ee9-a73a-719ae2dd6c67] received 2024-02-23T03:02:01.242730447Z [2024-02-23 03:02:01,242: INFO/ForkPoolWorker-15] [7ec2fde8-a157-4a99-b1f8-6a36982d4f9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:02:01.243055203Z [2024-02-23 03:02:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b533ff07-e0e8-4b5b-a8b4-5b7c7e8f8603] received 2024-02-23T03:02:01.252135780Z [2024-02-23 03:02:01,251: INFO/ForkPoolWorker-16] [945228f6-aa23-448e-b56d-eb87bee8db44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:02:01.264493131Z [2024-02-23 03:02:01,264: INFO/ForkPoolWorker-1] [0d0a6088-3e59-4ee9-a73a-719ae2dd6c67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:02:01.266182957Z [2024-02-23 03:02:01,265: INFO/ForkPoolWorker-2] [b533ff07-e0e8-4b5b-a8b4-5b7c7e8f8603] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:02:01.764288158Z [2024-02-23 03:02:01,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:02:01.766870845Z [2024-02-23 03:02:01,760: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:02:01.875445442Z [2024-02-23 03:02:01,872: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:02:01.945094473Z [2024-02-23 03:02:01,938: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:02:02.546633075Z [2024-02-23 03:02:02,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:02:02.587797650Z [2024-02-23 03:02:02,586: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:02:02.609494132Z [2024-02-23 03:02:02,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:02:02.664684118Z [2024-02-23 03:02:02,664: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:02:02.665921597Z [2024-02-23 03:02:02,665: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:02:02.666112124Z [2024-02-23 03:02:02,665: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:02:02.666280416Z [2024-02-23 03:02:02,666: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:02:02.666546083Z [2024-02-23 03:02:02,666: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:02:02.793826595Z [2024-02-23 03:02:02,793: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:02:03.404583754Z [2024-02-23 03:02:03,404: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ec2fde8-a157-4a99-b1f8-6a36982d4f9c] succeeded in 2.1683989849989302s: None 2024-02-23T03:02:03.666595887Z [2024-02-23 03:02:03,666: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d0a6088-3e59-4ee9-a73a-719ae2dd6c67] succeeded in 2.42269399199904s: None 2024-02-23T03:02:03.746451314Z [2024-02-23 03:02:03,746: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:02:03.750559256Z [2024-02-23 03:02:03,750: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:02:03.773797401Z [2024-02-23 03:02:03,773: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:02:03.775475962Z [2024-02-23 03:02:03,775: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:02:03.775494471Z [2024-02-23 03:02:03,775: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:02:03.775611778Z [2024-02-23 03:02:03,775: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:02:03.775649706Z [2024-02-23 03:02:03,775: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:02:03.775923922Z [2024-02-23 03:02:03,775: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:02:03.775937142Z [2024-02-23 03:02:03,775: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:02:03.779155519Z [2024-02-23 03:02:03,778: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:02:03.783227915Z [2024-02-23 03:02:03,782: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:02:03.810893565Z [2024-02-23 03:02:03,810: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:02:03.812304224Z [2024-02-23 03:02:03,812: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:02:03.812433957Z [2024-02-23 03:02:03,812: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:02:03.812629194Z [2024-02-23 03:02:03,812: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:02:03.812767531Z [2024-02-23 03:02:03,812: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:02:03.813171670Z [2024-02-23 03:02:03,813: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:02:03.813346686Z [2024-02-23 03:02:03,813: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:02:03.860332144Z [2024-02-23 03:02:03,860: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:02:03.961248692Z [2024-02-23 03:02:03,960: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:02:05.858166847Z [2024-02-23 03:02:05,857: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[945228f6-aa23-448e-b56d-eb87bee8db44] succeeded in 4.6183513140003924s: None 2024-02-23T03:02:05.932468801Z [2024-02-23 03:02:05,932: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b533ff07-e0e8-4b5b-a8b4-5b7c7e8f8603] succeeded in 4.686914066000099s: None 2024-02-23T03:03:00.226727297Z [2024-02-23 03:03:00,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8527628e-d65c-46d2-8921-e773850e1cc6] received 2024-02-23T03:03:00.236021885Z [2024-02-23 03:03:00,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04360e1e-a62e-4247-8f54-3ee33773f243] received 2024-02-23T03:03:00.240546405Z [2024-02-23 03:03:00,240: INFO/ForkPoolWorker-15] [8527628e-d65c-46d2-8921-e773850e1cc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:03:00.242580681Z [2024-02-23 03:03:00,242: INFO/ForkPoolWorker-16] [04360e1e-a62e-4247-8f54-3ee33773f243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:03:00.245798008Z [2024-02-23 03:03:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e041fbe-621d-4b5b-b9d6-f24e87748f8f] received 2024-02-23T03:03:00.252950691Z [2024-02-23 03:03:00,252: INFO/ForkPoolWorker-1] [2e041fbe-621d-4b5b-b9d6-f24e87748f8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:03:00.534199746Z [2024-02-23 03:03:00,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:03:00.534453908Z [2024-02-23 03:03:00,531: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:03:00.609931325Z [2024-02-23 03:03:00,606: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:03:00.793772646Z [2024-02-23 03:03:00,793: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:03:00.798647582Z [2024-02-23 03:03:00,797: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:03:00.827900619Z [2024-02-23 03:03:00,827: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:03:00.830452711Z [2024-02-23 03:03:00,830: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:03:00.830619073Z [2024-02-23 03:03:00,830: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:03:00.830686719Z [2024-02-23 03:03:00,830: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:03:00.831416300Z [2024-02-23 03:03:00,831: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:03:00.922941481Z [2024-02-23 03:03:00,922: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:03:01.581399491Z [2024-02-23 03:03:01,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e041fbe-621d-4b5b-b9d6-f24e87748f8f] succeeded in 1.3340971659999923s: None 2024-02-23T03:03:01.685647031Z [2024-02-23 03:03:01,685: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:03:01.689015988Z [2024-02-23 03:03:01,688: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:03:01.708803804Z [2024-02-23 03:03:01,708: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:03:01.710478504Z [2024-02-23 03:03:01,710: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:03:01.710570108Z [2024-02-23 03:03:01,710: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:03:01.710906858Z [2024-02-23 03:03:01,710: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:03:01.711001684Z [2024-02-23 03:03:01,710: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:03:01.711355119Z [2024-02-23 03:03:01,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:03:01.711483179Z [2024-02-23 03:03:01,711: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:03:01.742884592Z [2024-02-23 03:03:01,742: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:03:01.746757016Z [2024-02-23 03:03:01,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:03:01.770245443Z [2024-02-23 03:03:01,769: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:03:01.771726048Z [2024-02-23 03:03:01,771: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:03:01.771778221Z [2024-02-23 03:03:01,771: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:03:01.771959375Z [2024-02-23 03:03:01,771: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:03:01.772027804Z [2024-02-23 03:03:01,771: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:03:01.772420196Z [2024-02-23 03:03:01,772: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:03:01.772493499Z [2024-02-23 03:03:01,772: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:03:01.795469282Z [2024-02-23 03:03:01,795: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:03:01.871789406Z [2024-02-23 03:03:01,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:03:03.308503478Z [2024-02-23 03:03:03,307: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04360e1e-a62e-4247-8f54-3ee33773f243] succeeded in 3.07073806399967s: None 2024-02-23T03:03:03.785345508Z [2024-02-23 03:03:03,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8527628e-d65c-46d2-8921-e773850e1cc6] succeeded in 3.55388565100111s: None 2024-02-23T03:04:00.322878314Z [2024-02-23 03:04:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48edcb60-18d9-4ec1-9e3b-d66825bda698] received 2024-02-23T03:04:00.329536782Z [2024-02-23 03:04:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cc2f0b7-dd37-4f81-af30-ffda3d0f6db1] received 2024-02-23T03:04:00.335286118Z [2024-02-23 03:04:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[878c76f3-4764-4e0e-9b9e-fd62aaa65c03] received 2024-02-23T03:04:00.340146617Z [2024-02-23 03:04:00,339: INFO/ForkPoolWorker-15] [48edcb60-18d9-4ec1-9e3b-d66825bda698] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:04:00.346419641Z [2024-02-23 03:04:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e54ac492-5d44-4df9-8774-82f34a69b46e] received 2024-02-23T03:04:00.348635733Z [2024-02-23 03:04:00,348: INFO/ForkPoolWorker-1] [878c76f3-4764-4e0e-9b9e-fd62aaa65c03] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:04:00.349850275Z [2024-02-23 03:04:00,349: INFO/ForkPoolWorker-16] [6cc2f0b7-dd37-4f81-af30-ffda3d0f6db1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:04:00.361815559Z [2024-02-23 03:04:00,361: INFO/ForkPoolWorker-2] [e54ac492-5d44-4df9-8774-82f34a69b46e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:04:00.651689953Z [2024-02-23 03:04:00,648: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:04:00.668995555Z [2024-02-23 03:04:00,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:04:00.733995973Z [2024-02-23 03:04:00,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:04:00.738456437Z [2024-02-23 03:04:00,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:04:00.862176477Z [2024-02-23 03:04:00,861: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:04:00.871780437Z [2024-02-23 03:04:00,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:04:00.917380194Z [2024-02-23 03:04:00,917: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:04:00.923253858Z [2024-02-23 03:04:00,923: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:04:00.923439384Z [2024-02-23 03:04:00,923: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:04:00.923559254Z [2024-02-23 03:04:00,923: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:04:00.923866813Z [2024-02-23 03:04:00,923: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:04:01.066336122Z [2024-02-23 03:04:01,066: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:04:01.070864940Z [2024-02-23 03:04:01,070: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:04:01.665987749Z [2024-02-23 03:04:01,665: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[878c76f3-4764-4e0e-9b9e-fd62aaa65c03] succeeded in 1.3292526559998805s: None 2024-02-23T03:04:01.676831439Z [2024-02-23 03:04:01,676: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6cc2f0b7-dd37-4f81-af30-ffda3d0f6db1] succeeded in 1.3428855070014833s: None 2024-02-23T03:04:02.098178207Z [2024-02-23 03:04:02,097: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:04:02.102641572Z [2024-02-23 03:04:02,102: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:04:02.123679356Z [2024-02-23 03:04:02,123: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:04:02.125250626Z [2024-02-23 03:04:02,125: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:04:02.125439877Z [2024-02-23 03:04:02,125: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:04:02.125620191Z [2024-02-23 03:04:02,125: INFO/ForkPoolWorker-2] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:04:02.125864614Z [2024-02-23 03:04:02,125: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:04:02.126239837Z [2024-02-23 03:04:02,126: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:04:02.126538282Z [2024-02-23 03:04:02,126: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:04:02.127000705Z [2024-02-23 03:04:02,126: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:04:02.131503273Z [2024-02-23 03:04:02,131: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:04:02.174419680Z [2024-02-23 03:04:02,174: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:04:02.177831692Z [2024-02-23 03:04:02,177: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:04:02.204976570Z [2024-02-23 03:04:02,204: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:04:02.206489462Z [2024-02-23 03:04:02,206: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:04:02.206553754Z [2024-02-23 03:04:02,206: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:04:02.206678740Z [2024-02-23 03:04:02,206: INFO/ForkPoolWorker-15] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:04:02.206950256Z [2024-02-23 03:04:02,206: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:04:02.207081267Z [2024-02-23 03:04:02,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:04:02.207375807Z [2024-02-23 03:04:02,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:04:02.207513066Z [2024-02-23 03:04:02,207: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:04:02.212212313Z [2024-02-23 03:04:02,211: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:04:02.249939959Z [2024-02-23 03:04:02,249: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:04:02.305877072Z [2024-02-23 03:04:02,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:04:03.895802584Z [2024-02-23 03:04:03,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48edcb60-18d9-4ec1-9e3b-d66825bda698] succeeded in 3.564395084998978s: None 2024-02-23T03:04:04.150595098Z [2024-02-23 03:04:04,149: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e54ac492-5d44-4df9-8774-82f34a69b46e] succeeded in 3.798810049000167s: None 2024-02-23T03:04:38.700252426Z [2024-02-23 03:04:38,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8b55e86-cfbd-4a10-9d12-9a5a11f75d0c] received 2024-02-23T03:04:38.718399366Z [2024-02-23 03:04:38,718: INFO/ForkPoolWorker-15] [c8b55e86-cfbd-4a10-9d12-9a5a11f75d0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223030437_085722', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T03:04:38.993964549Z [2024-02-23 03:04:38,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T03:04:39.308340877Z [2024-02-23 03:04:39,308: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:04:39.986910617Z [2024-02-23 03:04:39,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8b55e86-cfbd-4a10-9d12-9a5a11f75d0c] succeeded in 1.2774187990016799s: None 2024-02-23T03:05:00.353614358Z [2024-02-23 03:05:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6336159e-decc-4720-a6d1-50bb37971304] received 2024-02-23T03:05:00.356927981Z [2024-02-23 03:05:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7e5386d-caf5-47d6-afd7-57e06dec71b7] received 2024-02-23T03:05:00.366367116Z [2024-02-23 03:05:00,366: INFO/ForkPoolWorker-15] [6336159e-decc-4720-a6d1-50bb37971304] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:05:00.369812743Z [2024-02-23 03:05:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[571eb4ba-d1c5-4097-bfc3-dc4526a6f9fe] received 2024-02-23T03:05:00.372086413Z [2024-02-23 03:05:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94ecfe4b-1736-41f4-be18-3730f524394b] received 2024-02-23T03:05:00.387736708Z [2024-02-23 03:05:00,387: INFO/ForkPoolWorker-1] [571eb4ba-d1c5-4097-bfc3-dc4526a6f9fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:05:00.388757759Z [2024-02-23 03:05:00,388: INFO/ForkPoolWorker-2] [94ecfe4b-1736-41f4-be18-3730f524394b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:05:00.407911369Z [2024-02-23 03:05:00,407: INFO/ForkPoolWorker-16] [a7e5386d-caf5-47d6-afd7-57e06dec71b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:05:00.687753572Z [2024-02-23 03:05:00,683: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:05:00.748770572Z [2024-02-23 03:05:00,743: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:05:00.837064776Z [2024-02-23 03:05:00,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:05:00.856359695Z [2024-02-23 03:05:00,853: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:05:00.957287381Z [2024-02-23 03:05:00,956: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:05:00.961597341Z [2024-02-23 03:05:00,961: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:00.994621758Z [2024-02-23 03:05:00,994: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:05:00.995837621Z [2024-02-23 03:05:00,995: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:05:00.995922952Z [2024-02-23 03:05:00,995: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:05:00.996030892Z [2024-02-23 03:05:00,995: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:05:00.996293919Z [2024-02-23 03:05:00,996: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:05:01.107008347Z [2024-02-23 03:05:01,106: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:01.880863971Z [2024-02-23 03:05:01,880: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[571eb4ba-d1c5-4097-bfc3-dc4526a6f9fe] succeeded in 1.508639570998639s: None 2024-02-23T03:05:02.154907814Z [2024-02-23 03:05:02,154: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:05:02.158321001Z [2024-02-23 03:05:02,157: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:02.172358435Z [2024-02-23 03:05:02,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:05:02.175611327Z [2024-02-23 03:05:02,175: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:02.187906729Z [2024-02-23 03:05:02,187: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:05:02.189084935Z [2024-02-23 03:05:02,188: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:05:02.189112276Z [2024-02-23 03:05:02,189: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:05:02.189146862Z [2024-02-23 03:05:02,189: INFO/ForkPoolWorker-16] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:05:02.189300873Z [2024-02-23 03:05:02,189: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:05:02.189315188Z [2024-02-23 03:05:02,189: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:05:02.189946461Z [2024-02-23 03:05:02,189: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:02.189970099Z [2024-02-23 03:05:02,189: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:05:02.196532028Z [2024-02-23 03:05:02,196: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:02.197540069Z [2024-02-23 03:05:02,197: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:05:02.199625045Z [2024-02-23 03:05:02,199: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:05:02.199874245Z [2024-02-23 03:05:02,199: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:05:02.200107901Z [2024-02-23 03:05:02,199: INFO/ForkPoolWorker-15] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:05:02.200475541Z [2024-02-23 03:05:02,200: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:05:02.200671160Z [2024-02-23 03:05:02,200: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:05:02.201130053Z [2024-02-23 03:05:02,200: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:05:02.201334365Z [2024-02-23 03:05:02,201: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:05:02.208034339Z [2024-02-23 03:05:02,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:05:02.315441012Z [2024-02-23 03:05:02,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:02.347779247Z [2024-02-23 03:05:02,347: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:02.621772435Z [2024-02-23 03:05:02,621: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:05:02.625998929Z [2024-02-23 03:05:02,625: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:02.650433640Z [2024-02-23 03:05:02,650: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:05:02.651777525Z [2024-02-23 03:05:02,651: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:05:02.651798280Z [2024-02-23 03:05:02,651: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:05:02.651832791Z [2024-02-23 03:05:02,651: INFO/ForkPoolWorker-2] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:05:02.651970423Z [2024-02-23 03:05:02,651: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:05:02.652000056Z [2024-02-23 03:05:02,651: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:05:02.652226090Z [2024-02-23 03:05:02,652: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:05:02.652263583Z [2024-02-23 03:05:02,652: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:05:02.657075246Z [2024-02-23 03:05:02,656: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:05:02.745019243Z [2024-02-23 03:05:02,744: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:02.987709134Z [2024-02-23 03:05:02,987: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7e5386d-caf5-47d6-afd7-57e06dec71b7] succeeded in 2.6271937759993307s: None 2024-02-23T03:05:03.021951891Z [2024-02-23 03:05:03,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e7a338d-9e7e-4431-b3ee-6dcbee94420f] received 2024-02-23T03:05:03.031903821Z [2024-02-23 03:05:03,031: INFO/ForkPoolWorker-16] [2e7a338d-9e7e-4431-b3ee-6dcbee94420f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:05:03.371145210Z [2024-02-23 03:05:03,368: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:05:03.938733253Z [2024-02-23 03:05:03,938: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6336159e-decc-4720-a6d1-50bb37971304] succeeded in 3.5801464970008965s: None 2024-02-23T03:05:04.562880476Z [2024-02-23 03:05:04,562: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:05:04.566393364Z [2024-02-23 03:05:04,565: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:04.590099131Z [2024-02-23 03:05:04,589: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:05:04.591838334Z [2024-02-23 03:05:04,591: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:05:04.591934116Z [2024-02-23 03:05:04,591: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:05:04.592031821Z [2024-02-23 03:05:04,591: INFO/ForkPoolWorker-16] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:05:04.592183044Z [2024-02-23 03:05:04,592: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:05:04.592266208Z [2024-02-23 03:05:04,592: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:05:04.592535530Z [2024-02-23 03:05:04,592: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:04.592658457Z [2024-02-23 03:05:04,592: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:05:04.600328157Z [2024-02-23 03:05:04,600: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:04.647694306Z [2024-02-23 03:05:04,647: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[94ecfe4b-1736-41f4-be18-3730f524394b] succeeded in 4.271196981000685s: None 2024-02-23T03:05:04.732840683Z [2024-02-23 03:05:04,731: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:05.461707006Z [2024-02-23 03:05:05,461: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e7a338d-9e7e-4431-b3ee-6dcbee94420f] succeeded in 2.4374022920001153s: None 2024-02-23T03:05:05.968215083Z [2024-02-23 03:05:05,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aea5c856-b278-4464-ac07-5ac96f90f5ec] received 2024-02-23T03:05:05.975365904Z [2024-02-23 03:05:05,975: INFO/ForkPoolWorker-15] [aea5c856-b278-4464-ac07-5ac96f90f5ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:05:06.282800392Z [2024-02-23 03:05:06,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:05:07.407019161Z [2024-02-23 03:05:07,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:05:07.410405807Z [2024-02-23 03:05:07,409: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:07.434436615Z [2024-02-23 03:05:07,433: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:05:07.437603273Z [2024-02-23 03:05:07,437: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:05:07.437852099Z [2024-02-23 03:05:07,437: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:05:07.438091498Z [2024-02-23 03:05:07,437: INFO/ForkPoolWorker-15] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:05:07.438595197Z [2024-02-23 03:05:07,438: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:05:07.439040979Z [2024-02-23 03:05:07,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:05:07.439725720Z [2024-02-23 03:05:07,439: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:07.439986378Z [2024-02-23 03:05:07,439: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:05:07.455755051Z [2024-02-23 03:05:07,455: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:07.553224039Z [2024-02-23 03:05:07,552: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:08.166014628Z [2024-02-23 03:05:08,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aea5c856-b278-4464-ac07-5ac96f90f5ec] succeeded in 2.1953417170007015s: None 2024-02-23T03:05:08.192253373Z [2024-02-23 03:05:08,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c94ce296-35de-4622-9131-1334f099580e] received 2024-02-23T03:05:08.200895226Z [2024-02-23 03:05:08,200: INFO/ForkPoolWorker-15] [c94ce296-35de-4622-9131-1334f099580e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:05:08.503949342Z [2024-02-23 03:05:08,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:05:09.629313851Z [2024-02-23 03:05:09,628: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:05:09.632535881Z [2024-02-23 03:05:09,632: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:05:09.655215661Z [2024-02-23 03:05:09,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:05:09.656786118Z [2024-02-23 03:05:09,656: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:05:09.657299685Z [2024-02-23 03:05:09,657: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:05:09.667931850Z [2024-02-23 03:05:09,666: INFO/ForkPoolWorker-15] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:05:09.667956415Z [2024-02-23 03:05:09,667: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:05:09.667963089Z [2024-02-23 03:05:09,667: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:05:09.667968451Z [2024-02-23 03:05:09,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:09.667974444Z [2024-02-23 03:05:09,667: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:05:09.678283701Z [2024-02-23 03:05:09,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:05:09.805981361Z [2024-02-23 03:05:09,805: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:05:10.430720441Z [2024-02-23 03:05:10,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c94ce296-35de-4622-9131-1334f099580e] succeeded in 2.2367311870002595s: None 2024-02-23T03:06:00.315911635Z [2024-02-23 03:06:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[540401d1-1f54-44b3-91df-26943cccd4f3] received 2024-02-23T03:06:00.320949915Z [2024-02-23 03:06:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5380881-ebf6-4ce1-ad88-336da52f56ec] received 2024-02-23T03:06:00.331567495Z [2024-02-23 03:06:00,331: INFO/ForkPoolWorker-16] [e5380881-ebf6-4ce1-ad88-336da52f56ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:06:00.332544028Z [2024-02-23 03:06:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db2fa3ed-aa22-4e30-b4a7-759eeeccc126] received 2024-02-23T03:06:00.333280082Z [2024-02-23 03:06:00,333: INFO/ForkPoolWorker-15] [540401d1-1f54-44b3-91df-26943cccd4f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:06:00.334633160Z [2024-02-23 03:06:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82b8dcd6-1c19-4405-b3be-96d912ceea9e] received 2024-02-23T03:06:00.341174554Z [2024-02-23 03:06:00,340: INFO/ForkPoolWorker-2] [82b8dcd6-1c19-4405-b3be-96d912ceea9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:06:00.343132451Z [2024-02-23 03:06:00,342: INFO/ForkPoolWorker-1] [db2fa3ed-aa22-4e30-b4a7-759eeeccc126] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:06:00.682649736Z [2024-02-23 03:06:00,679: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:06:00.695505507Z [2024-02-23 03:06:00,692: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:06:00.702943257Z [2024-02-23 03:06:00,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:06:00.750921818Z [2024-02-23 03:06:00,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:06:00.902689998Z [2024-02-23 03:06:00,902: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:06:00.908149613Z [2024-02-23 03:06:00,907: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:06:00.939198685Z [2024-02-23 03:06:00,938: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:06:00.943517901Z [2024-02-23 03:06:00,943: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:06:00.943948271Z [2024-02-23 03:06:00,943: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:06:00.944438411Z [2024-02-23 03:06:00,943: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:06:00.945687560Z [2024-02-23 03:06:00,945: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:06:01.090309419Z [2024-02-23 03:06:01,090: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:06:01.160392790Z [2024-02-23 03:06:01,160: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:06:01.672475163Z [2024-02-23 03:06:01,672: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82b8dcd6-1c19-4405-b3be-96d912ceea9e] succeeded in 1.3363900829990598s: None 2024-02-23T03:06:01.804030408Z [2024-02-23 03:06:01,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[540401d1-1f54-44b3-91df-26943cccd4f3] succeeded in 1.484225690999665s: None 2024-02-23T03:06:02.105894346Z [2024-02-23 03:06:02,105: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:06:02.109347503Z [2024-02-23 03:06:02,108: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:06:02.131593735Z [2024-02-23 03:06:02,131: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:06:02.133745516Z [2024-02-23 03:06:02,133: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:06:02.133939257Z [2024-02-23 03:06:02,133: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:06:02.134081052Z [2024-02-23 03:06:02,133: INFO/ForkPoolWorker-16] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:06:02.134334344Z [2024-02-23 03:06:02,134: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:06:02.134467594Z [2024-02-23 03:06:02,134: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:06:02.136403119Z [2024-02-23 03:06:02,136: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:06:02.137091814Z [2024-02-23 03:06:02,136: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:06:02.141983103Z [2024-02-23 03:06:02,141: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:06:02.223070972Z [2024-02-23 03:06:02,222: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:06:02.235401544Z [2024-02-23 03:06:02,235: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:06:02.238784806Z [2024-02-23 03:06:02,238: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:06:02.270817825Z [2024-02-23 03:06:02,270: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:06:02.273193450Z [2024-02-23 03:06:02,272: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:06:02.273402915Z [2024-02-23 03:06:02,273: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:06:02.273812617Z [2024-02-23 03:06:02,273: INFO/ForkPoolWorker-1] Read VIM 044e1cf4-7575-4d17-8bfe-b95223de6a26 (k8s07_dummy) 2024-02-23T03:06:02.274226530Z [2024-02-23 03:06:02,273: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '044e1cf4-7575-4d17-8bfe-b95223de6a26', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-02-23T03:06:02.274499182Z [2024-02-23 03:06:02,274: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:06:02.275287628Z [2024-02-23 03:06:02,274: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:06:02.275446049Z [2024-02-23 03:06:02,275: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:06:02.282270186Z [2024-02-23 03:06:02,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:06:02.395243040Z [2024-02-23 03:06:02,394: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:06:04.090553677Z [2024-02-23 03:06:04,089: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db2fa3ed-aa22-4e30-b4a7-759eeeccc126] succeeded in 3.753564038001059s: None 2024-02-23T03:06:04.912987372Z [2024-02-23 03:06:04,912: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5380881-ebf6-4ce1-ad88-336da52f56ec] succeeded in 4.589382557000135s: None 2024-02-23T03:06:39.021772761Z [2024-02-23 03:06:39,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dd71219-88b3-422a-8abe-431c1295be2c] received 2024-02-23T03:06:39.033367700Z [2024-02-23 03:06:39,032: INFO/ForkPoolWorker-15] [1dd71219-88b3-422a-8abe-431c1295be2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223030637_138121', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T03:06:39.313032378Z [2024-02-23 03:06:39,310: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T03:06:39.621780899Z [2024-02-23 03:06:39,621: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:06:40.325260429Z [2024-02-23 03:06:40,320: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1dd71219-88b3-422a-8abe-431c1295be2c] succeeded in 1.2974475329992856s: None 2024-02-23T03:07:00.271137471Z [2024-02-23 03:07:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e47e58be-d5ca-48ce-8cf2-ba72b252e780] received 2024-02-23T03:07:00.280269233Z [2024-02-23 03:07:00,279: INFO/ForkPoolWorker-15] [e47e58be-d5ca-48ce-8cf2-ba72b252e780] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:07:00.294601710Z [2024-02-23 03:07:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[238ff3de-1caf-41be-a9b2-d7d367d82eb0] received 2024-02-23T03:07:00.299417764Z [2024-02-23 03:07:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01adfef2-4234-4e05-a145-008f27169b8c] received 2024-02-23T03:07:00.311251334Z [2024-02-23 03:07:00,311: INFO/ForkPoolWorker-16] [238ff3de-1caf-41be-a9b2-d7d367d82eb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:07:00.311568544Z [2024-02-23 03:07:00,311: INFO/ForkPoolWorker-1] [01adfef2-4234-4e05-a145-008f27169b8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:07:00.608297117Z [2024-02-23 03:07:00,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:07:00.632288077Z [2024-02-23 03:07:00,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:07:00.700154989Z [2024-02-23 03:07:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:07:00.798346684Z [2024-02-23 03:07:00,797: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:07:00.802228369Z [2024-02-23 03:07:00,801: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:07:00.823600944Z [2024-02-23 03:07:00,823: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:07:00.824592760Z [2024-02-23 03:07:00,824: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:07:00.824628948Z [2024-02-23 03:07:00,824: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:07:00.827252792Z [2024-02-23 03:07:00,827: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:07:00.828075741Z [2024-02-23 03:07:00,827: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:07:00.941180632Z [2024-02-23 03:07:00,940: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:07:01.547809206Z [2024-02-23 03:07:01,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e47e58be-d5ca-48ce-8cf2-ba72b252e780] succeeded in 1.273745158001475s: None 2024-02-23T03:07:01.926638538Z [2024-02-23 03:07:01,926: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:07:01.929888514Z [2024-02-23 03:07:01,929: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:07:01.946882323Z [2024-02-23 03:07:01,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:07:01.948122273Z [2024-02-23 03:07:01,947: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:07:01.948181780Z [2024-02-23 03:07:01,948: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:07:01.948341763Z [2024-02-23 03:07:01,948: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:07:01.948399035Z [2024-02-23 03:07:01,948: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:07:01.948642777Z [2024-02-23 03:07:01,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:07:01.948707255Z [2024-02-23 03:07:01,948: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:07:02.003322452Z [2024-02-23 03:07:02,002: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:07:02.006419444Z [2024-02-23 03:07:02,005: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:07:02.027749109Z [2024-02-23 03:07:02,027: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:07:02.028963239Z [2024-02-23 03:07:02,028: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:07:02.028982838Z [2024-02-23 03:07:02,028: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:07:02.029104713Z [2024-02-23 03:07:02,028: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:07:02.029168172Z [2024-02-23 03:07:02,029: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:07:02.029552327Z [2024-02-23 03:07:02,029: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:07:02.029648793Z [2024-02-23 03:07:02,029: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:07:02.042791830Z [2024-02-23 03:07:02,042: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:07:02.102143867Z [2024-02-23 03:07:02,101: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:07:03.685266564Z [2024-02-23 03:07:03,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01adfef2-4234-4e05-a145-008f27169b8c] succeeded in 3.380862382999112s: None 2024-02-23T03:07:04.423874177Z [2024-02-23 03:07:04,423: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[238ff3de-1caf-41be-a9b2-d7d367d82eb0] succeeded in 4.119435970998893s: None 2024-02-23T03:08:00.931540785Z [2024-02-23 03:08:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50e081d8-0247-4647-9faa-b246c2c3d9df] received 2024-02-23T03:08:00.934133434Z [2024-02-23 03:08:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cd9e011-078c-4bea-9090-4ddca05037c4] received 2024-02-23T03:08:00.935591660Z [2024-02-23 03:08:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77abaf3c-9195-4583-9ea4-4710bbc87354] received 2024-02-23T03:08:00.937029425Z [2024-02-23 03:08:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a56e016-8390-4411-9a20-b315bd38f26b] received 2024-02-23T03:08:00.942965439Z [2024-02-23 03:08:00,942: INFO/ForkPoolWorker-15] [50e081d8-0247-4647-9faa-b246c2c3d9df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:08:00.945293018Z [2024-02-23 03:08:00,945: INFO/ForkPoolWorker-1] [77abaf3c-9195-4583-9ea4-4710bbc87354] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:08:00.947583538Z [2024-02-23 03:08:00,947: INFO/ForkPoolWorker-2] [5a56e016-8390-4411-9a20-b315bd38f26b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:08:00.958963982Z [2024-02-23 03:08:00,958: INFO/ForkPoolWorker-16] [4cd9e011-078c-4bea-9090-4ddca05037c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:08:01.302645067Z [2024-02-23 03:08:01,299: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:08:01.360994891Z [2024-02-23 03:08:01,357: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:08:01.412430063Z [2024-02-23 03:08:01,409: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:08:01.433785391Z [2024-02-23 03:08:01,429: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:08:01.536191732Z [2024-02-23 03:08:01,535: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:08:01.540697776Z [2024-02-23 03:08:01,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:08:01.577651894Z [2024-02-23 03:08:01,577: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:08:01.581719481Z [2024-02-23 03:08:01,581: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:08:01.581993240Z [2024-02-23 03:08:01,581: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:08:01.582226363Z [2024-02-23 03:08:01,582: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:08:01.582724156Z [2024-02-23 03:08:01,582: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:08:01.705430344Z [2024-02-23 03:08:01,705: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:08:01.742088161Z [2024-02-23 03:08:01,741: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:08:02.409514480Z [2024-02-23 03:08:02,408: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cd9e011-078c-4bea-9090-4ddca05037c4] succeeded in 1.4709742449995247s: None 2024-02-23T03:08:02.461808191Z [2024-02-23 03:08:02,461: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77abaf3c-9195-4583-9ea4-4710bbc87354] succeeded in 1.5243958289993316s: None 2024-02-23T03:08:02.782008810Z [2024-02-23 03:08:02,781: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:08:02.786208316Z [2024-02-23 03:08:02,785: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:08:02.827856943Z [2024-02-23 03:08:02,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:08:02.831566080Z [2024-02-23 03:08:02,830: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:08:02.831748760Z [2024-02-23 03:08:02,831: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:08:02.832153282Z [2024-02-23 03:08:02,831: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:08:02.832429023Z [2024-02-23 03:08:02,832: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:08:02.832974739Z [2024-02-23 03:08:02,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:08:02.833876991Z [2024-02-23 03:08:02,833: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:08:02.917583655Z [2024-02-23 03:08:02,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:08:02.924827303Z [2024-02-23 03:08:02,924: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:08:02.928035575Z [2024-02-23 03:08:02,927: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:08:02.959511982Z [2024-02-23 03:08:02,959: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:08:02.961073655Z [2024-02-23 03:08:02,960: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:08:02.961092111Z [2024-02-23 03:08:02,960: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:08:02.961341158Z [2024-02-23 03:08:02,961: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:08:02.961421786Z [2024-02-23 03:08:02,961: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:08:02.961750496Z [2024-02-23 03:08:02,961: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:08:02.961884128Z [2024-02-23 03:08:02,961: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:08:03.055144005Z [2024-02-23 03:08:03,054: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:08:04.574402492Z [2024-02-23 03:08:04,573: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50e081d8-0247-4647-9faa-b246c2c3d9df] succeeded in 3.640892745999736s: None 2024-02-23T03:08:05.010924977Z [2024-02-23 03:08:05,010: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a56e016-8390-4411-9a20-b315bd38f26b] succeeded in 4.071787864999351s: None 2024-02-23T03:09:00.788807209Z [2024-02-23 03:09:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96d3ef93-7118-4ea8-b0da-5f6b6cf6bc28] received 2024-02-23T03:09:00.792673226Z [2024-02-23 03:09:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ff9d7e-9fa7-40ad-a458-382b55b3af75] received 2024-02-23T03:09:00.796453736Z [2024-02-23 03:09:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87ca86f3-245d-4deb-9699-9dc41b1a9bd9] received 2024-02-23T03:09:00.805362938Z [2024-02-23 03:09:00,803: INFO/ForkPoolWorker-15] [96d3ef93-7118-4ea8-b0da-5f6b6cf6bc28] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:09:00.806382767Z [2024-02-23 03:09:00,805: INFO/ForkPoolWorker-16] [c4ff9d7e-9fa7-40ad-a458-382b55b3af75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:09:00.807976049Z [2024-02-23 03:09:00,807: INFO/ForkPoolWorker-1] [87ca86f3-245d-4deb-9699-9dc41b1a9bd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:09:01.118733259Z [2024-02-23 03:09:01,115: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:09:01.118790866Z [2024-02-23 03:09:01,115: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:09:01.130431170Z [2024-02-23 03:09:01,126: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:09:01.275928988Z [2024-02-23 03:09:01,275: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:09:01.279760446Z [2024-02-23 03:09:01,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:09:01.324047609Z [2024-02-23 03:09:01,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:09:01.326218592Z [2024-02-23 03:09:01,325: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:09:01.326536654Z [2024-02-23 03:09:01,326: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:09:01.326794251Z [2024-02-23 03:09:01,326: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:09:01.327463387Z [2024-02-23 03:09:01,327: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:09:01.416537511Z [2024-02-23 03:09:01,416: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:09:02.175272478Z [2024-02-23 03:09:02,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96d3ef93-7118-4ea8-b0da-5f6b6cf6bc28] succeeded in 1.3820678920001228s: None 2024-02-23T03:09:02.386516805Z [2024-02-23 03:09:02,386: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:09:02.389822863Z [2024-02-23 03:09:02,389: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:09:02.413093261Z [2024-02-23 03:09:02,412: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:09:02.414335012Z [2024-02-23 03:09:02,414: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:09:02.414347542Z [2024-02-23 03:09:02,414: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:09:02.414561618Z [2024-02-23 03:09:02,414: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:09:02.414579914Z [2024-02-23 03:09:02,414: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:09:02.414920622Z [2024-02-23 03:09:02,414: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:09:02.414984953Z [2024-02-23 03:09:02,414: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:09:02.497753988Z [2024-02-23 03:09:02,497: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:09:02.653819831Z [2024-02-23 03:09:02,653: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:09:02.657269396Z [2024-02-23 03:09:02,656: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:09:02.678001664Z [2024-02-23 03:09:02,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:09:02.679539606Z [2024-02-23 03:09:02,679: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:09:02.679765480Z [2024-02-23 03:09:02,679: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:09:02.680024485Z [2024-02-23 03:09:02,679: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:09:02.680174415Z [2024-02-23 03:09:02,679: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:09:02.680545243Z [2024-02-23 03:09:02,680: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:09:02.680888810Z [2024-02-23 03:09:02,680: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:09:02.775043765Z [2024-02-23 03:09:02,774: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:09:04.257863124Z [2024-02-23 03:09:04,257: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87ca86f3-245d-4deb-9699-9dc41b1a9bd9] succeeded in 3.4595788349997747s: None 2024-02-23T03:09:06.217610717Z [2024-02-23 03:09:06,216: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4ff9d7e-9fa7-40ad-a458-382b55b3af75] succeeded in 5.4201090639999165s: None 2024-02-23T03:10:00.875542720Z [2024-02-23 03:10:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[619e5d3a-3432-45f0-a2dd-41d15ec459d5] received 2024-02-23T03:10:00.876999183Z [2024-02-23 03:10:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9ff79d7-34ec-4b1f-90a0-2ab6480ae559] received 2024-02-23T03:10:00.882710346Z [2024-02-23 03:10:00,882: INFO/ForkPoolWorker-16] [e9ff79d7-34ec-4b1f-90a0-2ab6480ae559] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:10:00.883151761Z [2024-02-23 03:10:00,882: INFO/ForkPoolWorker-15] [619e5d3a-3432-45f0-a2dd-41d15ec459d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:10:00.886678019Z [2024-02-23 03:10:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65b077bb-74b0-4174-bc6e-343af50d60b0] received 2024-02-23T03:10:00.894584270Z [2024-02-23 03:10:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802737ad-921d-4ae7-bc2c-5f0ef0c390ab] received 2024-02-23T03:10:00.896434408Z [2024-02-23 03:10:00,896: INFO/ForkPoolWorker-1] [65b077bb-74b0-4174-bc6e-343af50d60b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:10:00.900244337Z [2024-02-23 03:10:00,900: INFO/ForkPoolWorker-2] [802737ad-921d-4ae7-bc2c-5f0ef0c390ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:10:00.911496369Z [2024-02-23 03:10:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13ded3fe-2492-40c9-a847-60dd114c5f0a] received 2024-02-23T03:10:00.926632444Z [2024-02-23 03:10:00,926: INFO/ForkPoolWorker-3] [13ded3fe-2492-40c9-a847-60dd114c5f0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:10:01.362767428Z [2024-02-23 03:10:01,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:10:01.400330526Z [2024-02-23 03:10:01,397: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:10:01.452702033Z [2024-02-23 03:10:01,445: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:10:01.526574972Z [2024-02-23 03:10:01,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:10:01.591579186Z [2024-02-23 03:10:01,587: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:10:01.769598483Z [2024-02-23 03:10:01,769: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T03:10:01.773825284Z [2024-02-23 03:10:01,773: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:01.799777440Z [2024-02-23 03:10:01,799: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:10:01.800997497Z [2024-02-23 03:10:01,800: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:10:01.801170630Z [2024-02-23 03:10:01,800: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:10:01.801288275Z [2024-02-23 03:10:01,801: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T03:10:01.801696273Z [2024-02-23 03:10:01,801: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:10:01.815411437Z [2024-02-23 03:10:01,815: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:01.897004685Z [2024-02-23 03:10:01,896: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:02.985677607Z [2024-02-23 03:10:02,985: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65b077bb-74b0-4174-bc6e-343af50d60b0] succeeded in 2.0940746670003136s: None 2024-02-23T03:10:02.986211700Z [2024-02-23 03:10:02,985: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[13ded3fe-2492-40c9-a847-60dd114c5f0a] succeeded in 2.070856301999811s: None 2024-02-23T03:10:03.428236033Z [2024-02-23 03:10:03,427: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:10:03.432488711Z [2024-02-23 03:10:03,432: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:03.464274308Z [2024-02-23 03:10:03,464: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:10:03.466329034Z [2024-02-23 03:10:03,466: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:10:03.466379795Z [2024-02-23 03:10:03,466: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:10:03.466641939Z [2024-02-23 03:10:03,466: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:10:03.466764722Z [2024-02-23 03:10:03,466: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:10:03.467482135Z [2024-02-23 03:10:03,467: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:10:03.467664270Z [2024-02-23 03:10:03,467: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:10:03.551068355Z [2024-02-23 03:10:03,550: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:03.809982350Z [2024-02-23 03:10:03,809: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:10:03.819783617Z [2024-02-23 03:10:03,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:03.856953066Z [2024-02-23 03:10:03,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:10:03.858967198Z [2024-02-23 03:10:03,858: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:10:03.858988321Z [2024-02-23 03:10:03,858: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:10:03.859199619Z [2024-02-23 03:10:03,859: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:10:03.859305572Z [2024-02-23 03:10:03,859: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:10:03.859712516Z [2024-02-23 03:10:03,859: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:10:03.859861215Z [2024-02-23 03:10:03,859: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:10:03.878450400Z [2024-02-23 03:10:03,878: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:10:03.881906394Z [2024-02-23 03:10:03,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:03.917764015Z [2024-02-23 03:10:03,917: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:10:03.919733290Z [2024-02-23 03:10:03,919: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:10:03.919757128Z [2024-02-23 03:10:03,919: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:10:03.920010707Z [2024-02-23 03:10:03,919: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:10:03.920095719Z [2024-02-23 03:10:03,919: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:10:03.920454071Z [2024-02-23 03:10:03,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:10:03.921687691Z [2024-02-23 03:10:03,920: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:10:03.986148810Z [2024-02-23 03:10:03,985: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:04.050004002Z [2024-02-23 03:10:04,049: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:04.675240900Z [2024-02-23 03:10:04,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[619e5d3a-3432-45f0-a2dd-41d15ec459d5] succeeded in 3.796992178999062s: None 2024-02-23T03:10:04.878028099Z [2024-02-23 03:10:04,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a1b5a2e-e7f7-405e-b210-0274070269df] received 2024-02-23T03:10:04.888088031Z [2024-02-23 03:10:04,887: INFO/ForkPoolWorker-15] [5a1b5a2e-e7f7-405e-b210-0274070269df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:10:05.184366609Z [2024-02-23 03:10:05,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:10:05.423899833Z [2024-02-23 03:10:05,423: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[802737ad-921d-4ae7-bc2c-5f0ef0c390ab] succeeded in 4.527722236000045s: None 2024-02-23T03:10:06.446102570Z [2024-02-23 03:10:06,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:10:06.449764932Z [2024-02-23 03:10:06,449: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:06.469008232Z [2024-02-23 03:10:06,468: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:10:06.470506635Z [2024-02-23 03:10:06,470: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:10:06.470607995Z [2024-02-23 03:10:06,470: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:10:06.470786527Z [2024-02-23 03:10:06,470: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:10:06.471036457Z [2024-02-23 03:10:06,470: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:10:06.471342168Z [2024-02-23 03:10:06,471: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:10:06.471425009Z [2024-02-23 03:10:06,471: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:10:06.562291084Z [2024-02-23 03:10:06,562: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:06.773521742Z [2024-02-23 03:10:06,772: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9ff79d7-34ec-4b1f-90a0-2ab6480ae559] succeeded in 5.894955157000368s: None 2024-02-23T03:10:07.323980021Z [2024-02-23 03:10:07,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a1b5a2e-e7f7-405e-b210-0274070269df] succeeded in 2.441855578999821s: None 2024-02-23T03:10:08.355412679Z [2024-02-23 03:10:08,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[092edb58-b06b-4716-b666-534860b0ee2b] received 2024-02-23T03:10:08.368928730Z [2024-02-23 03:10:08,368: INFO/ForkPoolWorker-15] [092edb58-b06b-4716-b666-534860b0ee2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:10:08.682466290Z [2024-02-23 03:10:08,679: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:10:09.770978671Z [2024-02-23 03:10:09,768: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:10:09.775001675Z [2024-02-23 03:10:09,771: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:09.790053286Z [2024-02-23 03:10:09,789: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:10:09.791204852Z [2024-02-23 03:10:09,790: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:10:09.791227951Z [2024-02-23 03:10:09,791: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:10:09.791342868Z [2024-02-23 03:10:09,791: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:10:09.791354863Z [2024-02-23 03:10:09,791: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:10:09.791698304Z [2024-02-23 03:10:09,791: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:10:09.791704859Z [2024-02-23 03:10:09,791: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:10:09.880779258Z [2024-02-23 03:10:09,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:10.535957128Z [2024-02-23 03:10:10,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[092edb58-b06b-4716-b666-534860b0ee2b] succeeded in 2.1757987050004886s: None 2024-02-23T03:10:11.156680283Z [2024-02-23 03:10:11,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[272a9f58-456f-47b5-b005-3558220c4959] received 2024-02-23T03:10:11.167497756Z [2024-02-23 03:10:11,167: INFO/ForkPoolWorker-15] [272a9f58-456f-47b5-b005-3558220c4959] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:10:11.440605622Z [2024-02-23 03:10:11,437: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:10:12.505280061Z [2024-02-23 03:10:12,504: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:10:12.508358028Z [2024-02-23 03:10:12,507: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:10:12.529119427Z [2024-02-23 03:10:12,528: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:10:12.531191311Z [2024-02-23 03:10:12,530: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:10:12.531308264Z [2024-02-23 03:10:12,530: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:10:12.531335425Z [2024-02-23 03:10:12,531: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:10:12.531344521Z [2024-02-23 03:10:12,531: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:10:12.531679622Z [2024-02-23 03:10:12,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:10:12.531692439Z [2024-02-23 03:10:12,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:10:12.641158159Z [2024-02-23 03:10:12,640: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:10:13.257602425Z [2024-02-23 03:10:13,256: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[272a9f58-456f-47b5-b005-3558220c4959] succeeded in 2.09801301600055s: None 2024-02-23T03:11:01.008427217Z [2024-02-23 03:11:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c90e4be-82cf-412f-97da-e89e4233ce64] received 2024-02-23T03:11:01.014945028Z [2024-02-23 03:11:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28236d0a-691a-4b60-a88e-0535af03a67e] received 2024-02-23T03:11:01.017288759Z [2024-02-23 03:11:01,016: INFO/ForkPoolWorker-15] [7c90e4be-82cf-412f-97da-e89e4233ce64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:11:01.019783639Z [2024-02-23 03:11:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7eff259-faa2-4786-9619-ee610a9bb09a] received 2024-02-23T03:11:01.030005569Z [2024-02-23 03:11:01,029: INFO/ForkPoolWorker-1] [b7eff259-faa2-4786-9619-ee610a9bb09a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:11:01.031626553Z [2024-02-23 03:11:01,029: INFO/ForkPoolWorker-16] [28236d0a-691a-4b60-a88e-0535af03a67e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:11:01.362851711Z [2024-02-23 03:11:01,354: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:11:01.363551756Z [2024-02-23 03:11:01,359: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:11:01.462592447Z [2024-02-23 03:11:01,459: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:11:01.536933799Z [2024-02-23 03:11:01,536: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:11:01.540694878Z [2024-02-23 03:11:01,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:11:01.561847666Z [2024-02-23 03:11:01,561: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:11:01.562800509Z [2024-02-23 03:11:01,562: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:11:01.562911472Z [2024-02-23 03:11:01,562: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:11:01.563057822Z [2024-02-23 03:11:01,562: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:11:01.563269130Z [2024-02-23 03:11:01,563: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:11:01.656433064Z [2024-02-23 03:11:01,656: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:11:02.340410076Z [2024-02-23 03:11:02,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28236d0a-691a-4b60-a88e-0535af03a67e] succeeded in 1.3228224479989876s: None 2024-02-23T03:11:02.545597276Z [2024-02-23 03:11:02,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:11:02.550625253Z [2024-02-23 03:11:02,548: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:11:02.566005141Z [2024-02-23 03:11:02,565: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:11:02.567511365Z [2024-02-23 03:11:02,567: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:11:02.567601746Z [2024-02-23 03:11:02,567: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:11:02.567747632Z [2024-02-23 03:11:02,567: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:11:02.567822821Z [2024-02-23 03:11:02,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:11:02.568095522Z [2024-02-23 03:11:02,567: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:11:02.568187890Z [2024-02-23 03:11:02,568: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:11:02.661563927Z [2024-02-23 03:11:02,661: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:11:02.955904440Z [2024-02-23 03:11:02,955: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:11:02.959534557Z [2024-02-23 03:11:02,959: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:11:02.997983773Z [2024-02-23 03:11:02,997: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:11:03.000186892Z [2024-02-23 03:11:02,999: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:11:03.003266256Z [2024-02-23 03:11:03,000: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:11:03.005600863Z [2024-02-23 03:11:03,005: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:11:03.005867999Z [2024-02-23 03:11:03,005: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:11:03.006629927Z [2024-02-23 03:11:03,006: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:11:03.006938349Z [2024-02-23 03:11:03,006: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:11:03.145467206Z [2024-02-23 03:11:03,145: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:11:04.918231320Z [2024-02-23 03:11:04,917: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c90e4be-82cf-412f-97da-e89e4233ce64] succeeded in 3.9078309159995115s: None 2024-02-23T03:11:06.656418930Z [2024-02-23 03:11:06,656: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b7eff259-faa2-4786-9619-ee610a9bb09a] succeeded in 5.635282334000294s: None 2024-02-23T03:12:00.277584761Z [2024-02-23 03:12:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aee17e2-eb15-4e5c-8ae8-bbc9bdf2448b] received 2024-02-23T03:12:00.283447953Z [2024-02-23 03:12:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbe5ec8f-33b7-44bc-8cac-beb39e5befed] received 2024-02-23T03:12:00.284756657Z [2024-02-23 03:12:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cf3d6ca-5f0e-48af-8724-81db5248a87c] received 2024-02-23T03:12:00.290136633Z [2024-02-23 03:12:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09067a07-b960-40be-8d40-d9b504ebc558] received 2024-02-23T03:12:00.291618231Z [2024-02-23 03:12:00,291: INFO/ForkPoolWorker-1] [3cf3d6ca-5f0e-48af-8724-81db5248a87c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:12:00.298191639Z [2024-02-23 03:12:00,297: INFO/ForkPoolWorker-2] [09067a07-b960-40be-8d40-d9b504ebc558] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:12:00.299079410Z [2024-02-23 03:12:00,298: INFO/ForkPoolWorker-15] [9aee17e2-eb15-4e5c-8ae8-bbc9bdf2448b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:12:00.303804623Z [2024-02-23 03:12:00,303: INFO/ForkPoolWorker-16] [fbe5ec8f-33b7-44bc-8cac-beb39e5befed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:12:00.668706014Z [2024-02-23 03:12:00,665: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:12:00.715350414Z [2024-02-23 03:12:00,712: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:12:00.728659542Z [2024-02-23 03:12:00,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:12:00.823808592Z [2024-02-23 03:12:00,817: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:12:00.931262557Z [2024-02-23 03:12:00,930: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:12:00.936827383Z [2024-02-23 03:12:00,936: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:12:00.966561003Z [2024-02-23 03:12:00,966: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:12:00.968237141Z [2024-02-23 03:12:00,967: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:12:00.968487060Z [2024-02-23 03:12:00,968: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:12:00.968707641Z [2024-02-23 03:12:00,968: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:12:00.969155695Z [2024-02-23 03:12:00,968: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:12:01.065432866Z [2024-02-23 03:12:01,065: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:12:01.240657814Z [2024-02-23 03:12:01,240: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:12:01.746688105Z [2024-02-23 03:12:01,745: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[09067a07-b960-40be-8d40-d9b504ebc558] succeeded in 1.4537373729999672s: None 2024-02-23T03:12:01.842732030Z [2024-02-23 03:12:01,842: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fbe5ec8f-33b7-44bc-8cac-beb39e5befed] succeeded in 1.5556071379996865s: None 2024-02-23T03:12:01.943884317Z [2024-02-23 03:12:01,943: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:12:01.949237843Z [2024-02-23 03:12:01,947: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:12:01.973032423Z [2024-02-23 03:12:01,972: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:12:01.975098946Z [2024-02-23 03:12:01,974: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:12:01.975311818Z [2024-02-23 03:12:01,975: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:12:01.975497869Z [2024-02-23 03:12:01,975: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:12:01.975621211Z [2024-02-23 03:12:01,975: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:12:01.975904247Z [2024-02-23 03:12:01,975: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:12:01.976006506Z [2024-02-23 03:12:01,975: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:12:02.109915208Z [2024-02-23 03:12:02,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:12:02.227791183Z [2024-02-23 03:12:02,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:12:02.231003938Z [2024-02-23 03:12:02,230: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:12:02.270031933Z [2024-02-23 03:12:02,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:12:02.272082007Z [2024-02-23 03:12:02,271: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:12:02.272293699Z [2024-02-23 03:12:02,272: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:12:02.272640834Z [2024-02-23 03:12:02,272: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:12:02.272862203Z [2024-02-23 03:12:02,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:12:02.273585423Z [2024-02-23 03:12:02,273: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:12:02.273735250Z [2024-02-23 03:12:02,273: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:12:02.372584763Z [2024-02-23 03:12:02,372: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:12:04.316126123Z [2024-02-23 03:12:04,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cf3d6ca-5f0e-48af-8724-81db5248a87c] succeeded in 4.029965965999509s: None 2024-02-23T03:12:04.571113841Z [2024-02-23 03:12:04,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9aee17e2-eb15-4e5c-8ae8-bbc9bdf2448b] succeeded in 4.288921348001168s: None 2024-02-23T03:13:00.708874828Z [2024-02-23 03:13:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87f4bb55-5198-46ee-aa1d-8f72a095452f] received 2024-02-23T03:13:00.711430039Z [2024-02-23 03:13:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c26727f3-ec94-49d9-9590-c6f4e72de689] received 2024-02-23T03:13:00.715456426Z [2024-02-23 03:13:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49096c25-c6d4-4342-a25b-9724ff387b5e] received 2024-02-23T03:13:00.717145000Z [2024-02-23 03:13:00,716: INFO/ForkPoolWorker-15] [87f4bb55-5198-46ee-aa1d-8f72a095452f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:13:00.720232957Z [2024-02-23 03:13:00,719: INFO/ForkPoolWorker-16] [c26727f3-ec94-49d9-9590-c6f4e72de689] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:13:00.726418420Z [2024-02-23 03:13:00,726: INFO/ForkPoolWorker-1] [49096c25-c6d4-4342-a25b-9724ff387b5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:13:01.042525634Z [2024-02-23 03:13:01,037: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:13:01.085854413Z [2024-02-23 03:13:01,080: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:13:01.144060393Z [2024-02-23 03:13:01,141: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:13:01.233280269Z [2024-02-23 03:13:01,232: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:13:01.237522067Z [2024-02-23 03:13:01,236: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:13:01.275865485Z [2024-02-23 03:13:01,275: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:13:01.277033485Z [2024-02-23 03:13:01,276: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:13:01.277295579Z [2024-02-23 03:13:01,276: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:13:01.277462448Z [2024-02-23 03:13:01,277: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:13:01.277871810Z [2024-02-23 03:13:01,277: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:13:01.388389665Z [2024-02-23 03:13:01,388: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:13:02.101522142Z [2024-02-23 03:13:02,100: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49096c25-c6d4-4342-a25b-9724ff387b5e] succeeded in 1.3828478249997715s: None 2024-02-23T03:13:02.228455004Z [2024-02-23 03:13:02,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:13:02.231752277Z [2024-02-23 03:13:02,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:13:02.261462563Z [2024-02-23 03:13:02,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:13:02.264234539Z [2024-02-23 03:13:02,263: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:13:02.264681414Z [2024-02-23 03:13:02,264: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:13:02.265286617Z [2024-02-23 03:13:02,264: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:13:02.265612866Z [2024-02-23 03:13:02,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:13:02.266121351Z [2024-02-23 03:13:02,265: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:13:02.266722233Z [2024-02-23 03:13:02,266: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:13:02.350509058Z [2024-02-23 03:13:02,350: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:13:02.353988876Z [2024-02-23 03:13:02,353: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:13:02.382462640Z [2024-02-23 03:13:02,382: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:13:02.387443181Z [2024-02-23 03:13:02,387: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:13:02.389252300Z [2024-02-23 03:13:02,388: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:13:02.389845803Z [2024-02-23 03:13:02,389: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:13:02.390179770Z [2024-02-23 03:13:02,389: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:13:02.392494246Z [2024-02-23 03:13:02,392: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:13:02.393206728Z [2024-02-23 03:13:02,392: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:13:02.405760116Z [2024-02-23 03:13:02,405: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:13:02.525106576Z [2024-02-23 03:13:02,524: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:13:04.738972016Z [2024-02-23 03:13:04,737: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c26727f3-ec94-49d9-9590-c6f4e72de689] succeeded in 4.024174045998734s: None 2024-02-23T03:13:05.252124801Z [2024-02-23 03:13:05,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87f4bb55-5198-46ee-aa1d-8f72a095452f] succeeded in 4.541552175000106s: None 2024-02-23T03:14:01.151338908Z [2024-02-23 03:14:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7650776b-386d-4714-843d-5f097447f35e] received 2024-02-23T03:14:01.154274055Z [2024-02-23 03:14:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07735396-de2a-4f6a-b64e-0d863ec512cb] received 2024-02-23T03:14:01.162361567Z [2024-02-23 03:14:01,162: INFO/ForkPoolWorker-15] [7650776b-386d-4714-843d-5f097447f35e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:14:01.167445457Z [2024-02-23 03:14:01,167: INFO/ForkPoolWorker-16] [07735396-de2a-4f6a-b64e-0d863ec512cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:14:01.172230519Z [2024-02-23 03:14:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a36878d-7480-403d-a3af-b6393b6ccd3e] received 2024-02-23T03:14:01.178303281Z [2024-02-23 03:14:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01c902a0-f159-42f5-bb0c-09a71e349772] received 2024-02-23T03:14:01.184204302Z [2024-02-23 03:14:01,183: INFO/ForkPoolWorker-1] [8a36878d-7480-403d-a3af-b6393b6ccd3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:14:01.185701385Z [2024-02-23 03:14:01,185: INFO/ForkPoolWorker-2] [01c902a0-f159-42f5-bb0c-09a71e349772] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:14:01.449605205Z [2024-02-23 03:14:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:14:01.519915163Z [2024-02-23 03:14:01,516: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:14:01.655604255Z [2024-02-23 03:14:01,651: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:14:01.655812074Z [2024-02-23 03:14:01,647: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:14:01.735511025Z [2024-02-23 03:14:01,735: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:14:01.755267551Z [2024-02-23 03:14:01,752: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:14:01.799314884Z [2024-02-23 03:14:01,799: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:14:01.805355102Z [2024-02-23 03:14:01,805: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:14:01.805712398Z [2024-02-23 03:14:01,805: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:14:01.805897012Z [2024-02-23 03:14:01,805: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:14:01.807063021Z [2024-02-23 03:14:01,806: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:14:01.847575015Z [2024-02-23 03:14:01,847: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:14:01.894117896Z [2024-02-23 03:14:01,893: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:14:02.599335661Z [2024-02-23 03:14:02,598: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01c902a0-f159-42f5-bb0c-09a71e349772] succeeded in 1.4190403049997258s: None 2024-02-23T03:14:02.630228060Z [2024-02-23 03:14:02,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7650776b-386d-4714-843d-5f097447f35e] succeeded in 1.474092913000277s: None 2024-02-23T03:14:02.961978029Z [2024-02-23 03:14:02,961: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:14:02.965884691Z [2024-02-23 03:14:02,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:14:02.988241775Z [2024-02-23 03:14:02,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:14:02.989732858Z [2024-02-23 03:14:02,989: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:14:02.989956309Z [2024-02-23 03:14:02,989: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:14:02.990190690Z [2024-02-23 03:14:02,990: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:14:02.990343072Z [2024-02-23 03:14:02,990: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:14:02.990675804Z [2024-02-23 03:14:02,990: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:14:02.991220441Z [2024-02-23 03:14:02,991: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:14:03.067012191Z [2024-02-23 03:14:03,066: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:14:03.070527156Z [2024-02-23 03:14:03,069: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:14:03.093949495Z [2024-02-23 03:14:03,093: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:14:03.116962998Z [2024-02-23 03:14:03,116: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:14:03.118889658Z [2024-02-23 03:14:03,118: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:14:03.121699966Z [2024-02-23 03:14:03,119: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:14:03.121959116Z [2024-02-23 03:14:03,121: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:14:03.122062956Z [2024-02-23 03:14:03,121: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:14:03.122551075Z [2024-02-23 03:14:03,122: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:14:03.123582167Z [2024-02-23 03:14:03,122: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:14:03.208096246Z [2024-02-23 03:14:03,207: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:14:05.027299562Z [2024-02-23 03:14:05,026: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a36878d-7480-403d-a3af-b6393b6ccd3e] succeeded in 3.8500469720002s: None 2024-02-23T03:14:05.187798122Z [2024-02-23 03:14:05,187: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[07735396-de2a-4f6a-b64e-0d863ec512cb] succeeded in 4.029958455999804s: None 2024-02-23T03:15:01.233835175Z [2024-02-23 03:15:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b1193be-d99a-4114-ac05-cc91a1713ab6] received 2024-02-23T03:15:01.241488310Z [2024-02-23 03:15:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0b6f0f0-b946-4179-b79d-6f3ae4ee3a7c] received 2024-02-23T03:15:01.242213207Z [2024-02-23 03:15:01,241: INFO/ForkPoolWorker-15] [8b1193be-d99a-4114-ac05-cc91a1713ab6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:15:01.249784395Z [2024-02-23 03:15:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ab0e8ec-3b11-4b8f-bf8c-9fe942bc0fdc] received 2024-02-23T03:15:01.253959627Z [2024-02-23 03:15:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53c7bdb8-c486-431f-9fc3-87ef30e7eb29] received 2024-02-23T03:15:01.273203156Z [2024-02-23 03:15:01,272: INFO/ForkPoolWorker-16] [b0b6f0f0-b946-4179-b79d-6f3ae4ee3a7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:15:01.273960210Z [2024-02-23 03:15:01,273: INFO/ForkPoolWorker-1] [2ab0e8ec-3b11-4b8f-bf8c-9fe942bc0fdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:15:01.274542174Z [2024-02-23 03:15:01,274: INFO/ForkPoolWorker-2] [53c7bdb8-c486-431f-9fc3-87ef30e7eb29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:15:01.639978965Z [2024-02-23 03:15:01,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:15:01.673713247Z [2024-02-23 03:15:01,669: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:15:01.736650485Z [2024-02-23 03:15:01,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:15:01.799270582Z [2024-02-23 03:15:01,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:15:01.823151140Z [2024-02-23 03:15:01,817: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:15:01.823193823Z [2024-02-23 03:15:01,821: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:01.852817040Z [2024-02-23 03:15:01,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:15:01.853936183Z [2024-02-23 03:15:01,853: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:15:01.853992115Z [2024-02-23 03:15:01,853: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:15:01.854033539Z [2024-02-23 03:15:01,853: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:15:01.854226938Z [2024-02-23 03:15:01,854: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:15:01.964206571Z [2024-02-23 03:15:01,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:02.591210862Z [2024-02-23 03:15:02,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0b6f0f0-b946-4179-b79d-6f3ae4ee3a7c] succeeded in 1.3410688339990884s: None 2024-02-23T03:15:03.109445181Z [2024-02-23 03:15:03,109: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:15:03.113492136Z [2024-02-23 03:15:03,112: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:03.150201306Z [2024-02-23 03:15:03,149: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:15:03.152275755Z [2024-02-23 03:15:03,151: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:15:03.152681447Z [2024-02-23 03:15:03,152: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:15:03.153165924Z [2024-02-23 03:15:03,152: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:15:03.153503329Z [2024-02-23 03:15:03,153: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:15:03.154197311Z [2024-02-23 03:15:03,153: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:15:03.154563867Z [2024-02-23 03:15:03,154: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:15:03.234247282Z [2024-02-23 03:15:03,233: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:15:03.239064630Z [2024-02-23 03:15:03,238: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:03.264495558Z [2024-02-23 03:15:03,264: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:15:03.266220317Z [2024-02-23 03:15:03,265: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:15:03.266375679Z [2024-02-23 03:15:03,266: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:15:03.266726210Z [2024-02-23 03:15:03,266: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:15:03.267008490Z [2024-02-23 03:15:03,266: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:15:03.267537743Z [2024-02-23 03:15:03,267: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:15:03.267706829Z [2024-02-23 03:15:03,267: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:15:03.275379527Z [2024-02-23 03:15:03,274: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:03.395325317Z [2024-02-23 03:15:03,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:03.401482162Z [2024-02-23 03:15:03,401: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:15:03.404781338Z [2024-02-23 03:15:03,404: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:03.431482456Z [2024-02-23 03:15:03,431: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:15:03.432961030Z [2024-02-23 03:15:03,432: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:15:03.432988659Z [2024-02-23 03:15:03,432: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:15:03.433065488Z [2024-02-23 03:15:03,432: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:15:03.433175878Z [2024-02-23 03:15:03,433: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:15:03.433381993Z [2024-02-23 03:15:03,433: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:15:03.433445236Z [2024-02-23 03:15:03,433: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:15:03.534314212Z [2024-02-23 03:15:03,533: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:04.034150818Z [2024-02-23 03:15:04,033: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ab0e8ec-3b11-4b8f-bf8c-9fe942bc0fdc] succeeded in 2.776848161000089s: None 2024-02-23T03:15:04.039273159Z [2024-02-23 03:15:04,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9512d222-c4f2-469a-b647-565d00c49e82] received 2024-02-23T03:15:04.070377884Z [2024-02-23 03:15:04,069: INFO/ForkPoolWorker-16] [9512d222-c4f2-469a-b647-565d00c49e82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:15:04.370475807Z [2024-02-23 03:15:04,367: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:15:05.077150798Z [2024-02-23 03:15:05,076: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b1193be-d99a-4114-ac05-cc91a1713ab6] succeeded in 3.8413891269992746s: None 2024-02-23T03:15:05.564942924Z [2024-02-23 03:15:05,564: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[53c7bdb8-c486-431f-9fc3-87ef30e7eb29] succeeded in 4.30565720300001s: None 2024-02-23T03:15:05.749633302Z [2024-02-23 03:15:05,749: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:15:05.752978585Z [2024-02-23 03:15:05,752: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:05.775199103Z [2024-02-23 03:15:05,774: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:15:05.777391537Z [2024-02-23 03:15:05,777: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:15:05.777420015Z [2024-02-23 03:15:05,777: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:15:05.777512775Z [2024-02-23 03:15:05,777: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:15:05.777580277Z [2024-02-23 03:15:05,777: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:15:05.778022693Z [2024-02-23 03:15:05,777: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:15:05.778041411Z [2024-02-23 03:15:05,777: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:15:05.876194015Z [2024-02-23 03:15:05,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:06.568791569Z [2024-02-23 03:15:06,568: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9512d222-c4f2-469a-b647-565d00c49e82] succeeded in 2.525383617999978s: None 2024-02-23T03:15:07.088715873Z [2024-02-23 03:15:07,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f40329a-88d2-40d2-b29b-54e63f6d3b55] received 2024-02-23T03:15:07.098387996Z [2024-02-23 03:15:07,098: INFO/ForkPoolWorker-15] [9f40329a-88d2-40d2-b29b-54e63f6d3b55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:15:07.377700328Z [2024-02-23 03:15:07,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:15:08.542507794Z [2024-02-23 03:15:08,541: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:15:08.549625798Z [2024-02-23 03:15:08,548: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:08.578206194Z [2024-02-23 03:15:08,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:15:08.580129345Z [2024-02-23 03:15:08,579: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:15:08.580231807Z [2024-02-23 03:15:08,580: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:15:08.580420960Z [2024-02-23 03:15:08,580: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:15:08.580526116Z [2024-02-23 03:15:08,580: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:15:08.580856849Z [2024-02-23 03:15:08,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:15:08.580944317Z [2024-02-23 03:15:08,580: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:15:08.690994607Z [2024-02-23 03:15:08,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:09.231567725Z [2024-02-23 03:15:09,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eb68ea0-6ba6-4c3e-bf74-dcf2a2afb4f0] received 2024-02-23T03:15:09.240052362Z [2024-02-23 03:15:09,239: INFO/ForkPoolWorker-16] [9eb68ea0-6ba6-4c3e-bf74-dcf2a2afb4f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:15:09.277776571Z [2024-02-23 03:15:09,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f40329a-88d2-40d2-b29b-54e63f6d3b55] succeeded in 2.1873676300001534s: None 2024-02-23T03:15:09.560292839Z [2024-02-23 03:15:09,557: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:15:10.743343488Z [2024-02-23 03:15:10,742: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:15:10.746911903Z [2024-02-23 03:15:10,746: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:15:10.764481722Z [2024-02-23 03:15:10,764: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:15:10.765469083Z [2024-02-23 03:15:10,765: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:15:10.765484086Z [2024-02-23 03:15:10,765: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:15:10.765616321Z [2024-02-23 03:15:10,765: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:15:10.765641110Z [2024-02-23 03:15:10,765: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:15:10.765855325Z [2024-02-23 03:15:10,765: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:15:10.765878729Z [2024-02-23 03:15:10,765: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:15:10.851803050Z [2024-02-23 03:15:10,851: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:15:11.378794518Z [2024-02-23 03:15:11,378: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9eb68ea0-6ba6-4c3e-bf74-dcf2a2afb4f0] succeeded in 2.1446171409988892s: None 2024-02-23T03:16:01.215298213Z [2024-02-23 03:16:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b1ce60a-b590-4072-932c-2c7c6425002e] received 2024-02-23T03:16:01.217082777Z [2024-02-23 03:16:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[931db03e-1cca-4365-8093-69b9a9251d37] received 2024-02-23T03:16:01.224707736Z [2024-02-23 03:16:01,224: INFO/ForkPoolWorker-16] [931db03e-1cca-4365-8093-69b9a9251d37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:16:01.225437560Z [2024-02-23 03:16:01,225: INFO/ForkPoolWorker-15] [6b1ce60a-b590-4072-932c-2c7c6425002e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:16:01.241138364Z [2024-02-23 03:16:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4afd7f1-2df6-40ea-a7c2-e714970665e2] received 2024-02-23T03:16:01.242690094Z [2024-02-23 03:16:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[322b54dd-5f01-48ee-a359-14a5d2ca4ab5] received 2024-02-23T03:16:01.249345556Z [2024-02-23 03:16:01,249: INFO/ForkPoolWorker-1] [c4afd7f1-2df6-40ea-a7c2-e714970665e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:16:01.254525434Z [2024-02-23 03:16:01,254: INFO/ForkPoolWorker-2] [322b54dd-5f01-48ee-a359-14a5d2ca4ab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:16:01.561715883Z [2024-02-23 03:16:01,558: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:16:01.575173147Z [2024-02-23 03:16:01,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:16:01.577280025Z [2024-02-23 03:16:01,572: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:16:01.617716096Z [2024-02-23 03:16:01,614: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:16:01.827342586Z [2024-02-23 03:16:01,826: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:16:01.831934499Z [2024-02-23 03:16:01,831: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:16:01.853365170Z [2024-02-23 03:16:01,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:16:01.862388684Z [2024-02-23 03:16:01,862: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:16:01.863888239Z [2024-02-23 03:16:01,863: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:16:01.864152183Z [2024-02-23 03:16:01,863: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:16:01.864421304Z [2024-02-23 03:16:01,864: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:16:01.865237534Z [2024-02-23 03:16:01,864: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:16:01.984334941Z [2024-02-23 03:16:01,984: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:16:02.453381756Z [2024-02-23 03:16:02,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b1ce60a-b590-4072-932c-2c7c6425002e] succeeded in 1.2365470309996454s: None 2024-02-23T03:16:02.639118367Z [2024-02-23 03:16:02,638: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[322b54dd-5f01-48ee-a359-14a5d2ca4ab5] succeeded in 1.3949842840011115s: None 2024-02-23T03:16:02.917724427Z [2024-02-23 03:16:02,917: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:16:02.924194698Z [2024-02-23 03:16:02,923: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:16:02.948085361Z [2024-02-23 03:16:02,947: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:16:02.950458170Z [2024-02-23 03:16:02,950: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:16:02.951182392Z [2024-02-23 03:16:02,950: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:16:02.951550634Z [2024-02-23 03:16:02,951: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:16:02.951744664Z [2024-02-23 03:16:02,951: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:16:02.952215101Z [2024-02-23 03:16:02,952: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:16:02.952814200Z [2024-02-23 03:16:02,952: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:16:03.045802144Z [2024-02-23 03:16:03,045: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:16:03.125094976Z [2024-02-23 03:16:03,124: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:16:03.128533355Z [2024-02-23 03:16:03,127: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:16:03.164176867Z [2024-02-23 03:16:03,163: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:16:03.166203250Z [2024-02-23 03:16:03,165: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:16:03.166269460Z [2024-02-23 03:16:03,166: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:16:03.166512858Z [2024-02-23 03:16:03,166: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:16:03.166650409Z [2024-02-23 03:16:03,166: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:16:03.167300005Z [2024-02-23 03:16:03,167: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:16:03.167313568Z [2024-02-23 03:16:03,167: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:16:03.252521773Z [2024-02-23 03:16:03,252: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:16:05.231084541Z [2024-02-23 03:16:05,230: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4afd7f1-2df6-40ea-a7c2-e714970665e2] succeeded in 3.9882364430013695s: None 2024-02-23T03:16:06.398023256Z [2024-02-23 03:16:06,397: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[931db03e-1cca-4365-8093-69b9a9251d37] succeeded in 5.17949266299911s: None 2024-02-23T03:17:00.198909314Z [2024-02-23 03:17:00,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21b588b0-141e-4663-b14d-d306b3524191] received 2024-02-23T03:17:00.205558690Z [2024-02-23 03:17:00,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4250af43-3ab5-47d1-8165-a57b749a65ee] received 2024-02-23T03:17:00.206885469Z [2024-02-23 03:17:00,206: INFO/ForkPoolWorker-15] [21b588b0-141e-4663-b14d-d306b3524191] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:17:00.214142494Z [2024-02-23 03:17:00,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[704d0e6f-2e3b-491c-b88f-f6ea0ee8f035] received 2024-02-23T03:17:00.215769501Z [2024-02-23 03:17:00,215: INFO/ForkPoolWorker-16] [4250af43-3ab5-47d1-8165-a57b749a65ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:17:00.225839623Z [2024-02-23 03:17:00,225: INFO/ForkPoolWorker-1] [704d0e6f-2e3b-491c-b88f-f6ea0ee8f035] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:17:00.520827297Z [2024-02-23 03:17:00,517: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:17:00.526211560Z [2024-02-23 03:17:00,523: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:17:00.527031739Z [2024-02-23 03:17:00,523: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:17:00.689653456Z [2024-02-23 03:17:00,689: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:17:00.693610127Z [2024-02-23 03:17:00,693: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:17:00.715672932Z [2024-02-23 03:17:00,715: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:17:00.716703909Z [2024-02-23 03:17:00,716: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:17:00.716883750Z [2024-02-23 03:17:00,716: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:17:00.716994037Z [2024-02-23 03:17:00,716: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:17:00.717241768Z [2024-02-23 03:17:00,717: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:17:00.799326731Z [2024-02-23 03:17:00,799: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:17:01.386347132Z [2024-02-23 03:17:01,385: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[704d0e6f-2e3b-491c-b88f-f6ea0ee8f035] succeeded in 1.1705968709993613s: None 2024-02-23T03:17:01.736249656Z [2024-02-23 03:17:01,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:17:01.739846121Z [2024-02-23 03:17:01,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:17:01.743402069Z [2024-02-23 03:17:01,743: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:17:01.749451823Z [2024-02-23 03:17:01,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:17:01.773548123Z [2024-02-23 03:17:01,773: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:17:01.775004772Z [2024-02-23 03:17:01,774: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:17:01.775189596Z [2024-02-23 03:17:01,775: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:17:01.775411606Z [2024-02-23 03:17:01,775: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:17:01.775553407Z [2024-02-23 03:17:01,775: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:17:01.775680233Z [2024-02-23 03:17:01,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:17:01.776086115Z [2024-02-23 03:17:01,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:17:01.776237976Z [2024-02-23 03:17:01,776: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:17:01.777103801Z [2024-02-23 03:17:01,776: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:17:01.777221582Z [2024-02-23 03:17:01,777: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:17:01.777235721Z [2024-02-23 03:17:01,777: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:17:01.777312287Z [2024-02-23 03:17:01,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:17:01.777538514Z [2024-02-23 03:17:01,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:17:01.777547871Z [2024-02-23 03:17:01,777: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:17:01.863516566Z [2024-02-23 03:17:01,863: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:17:01.875347213Z [2024-02-23 03:17:01,874: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:17:03.415870250Z [2024-02-23 03:17:03,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4250af43-3ab5-47d1-8165-a57b749a65ee] succeeded in 3.207126335999419s: None 2024-02-23T03:17:03.753997597Z [2024-02-23 03:17:03,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21b588b0-141e-4663-b14d-d306b3524191] succeeded in 3.55252865500006s: None 2024-02-23T03:18:00.620767388Z [2024-02-23 03:18:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[953993ef-a1df-4a03-a83d-35cb354f9150] received 2024-02-23T03:18:00.625902699Z [2024-02-23 03:18:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c98943e9-3229-4cb4-8edc-12edb9880774] received 2024-02-23T03:18:00.627994615Z [2024-02-23 03:18:00,627: INFO/ForkPoolWorker-15] [953993ef-a1df-4a03-a83d-35cb354f9150] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:18:00.635983946Z [2024-02-23 03:18:00,635: INFO/ForkPoolWorker-16] [c98943e9-3229-4cb4-8edc-12edb9880774] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:18:00.641997820Z [2024-02-23 03:18:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef06028c-a33f-4428-b6f4-584bbd7ecbf4] received 2024-02-23T03:18:00.646966704Z [2024-02-23 03:18:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e792d08-3f10-45fc-99c3-45f1f634b34d] received 2024-02-23T03:18:00.649085678Z [2024-02-23 03:18:00,648: INFO/ForkPoolWorker-1] [ef06028c-a33f-4428-b6f4-584bbd7ecbf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:18:00.655298456Z [2024-02-23 03:18:00,655: INFO/ForkPoolWorker-2] [6e792d08-3f10-45fc-99c3-45f1f634b34d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:18:01.089906908Z [2024-02-23 03:18:01,085: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:18:01.154236668Z [2024-02-23 03:18:01,149: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:18:01.156863966Z [2024-02-23 03:18:01,153: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:18:01.185869833Z [2024-02-23 03:18:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:18:01.258932720Z [2024-02-23 03:18:01,258: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:18:01.264124207Z [2024-02-23 03:18:01,263: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:18:01.304055756Z [2024-02-23 03:18:01,303: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:18:01.305879913Z [2024-02-23 03:18:01,305: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:18:01.306071199Z [2024-02-23 03:18:01,305: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:18:01.306212544Z [2024-02-23 03:18:01,306: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:18:01.306610824Z [2024-02-23 03:18:01,306: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:18:01.453814873Z [2024-02-23 03:18:01,453: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:18:01.464600430Z [2024-02-23 03:18:01,464: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:18:02.226245367Z [2024-02-23 03:18:02,225: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[953993ef-a1df-4a03-a83d-35cb354f9150] succeeded in 1.6031844720000663s: None 2024-02-23T03:18:02.283474286Z [2024-02-23 03:18:02,283: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6e792d08-3f10-45fc-99c3-45f1f634b34d] succeeded in 1.6335543759996654s: None 2024-02-23T03:18:02.540994644Z [2024-02-23 03:18:02,540: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:18:02.544355981Z [2024-02-23 03:18:02,543: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:18:02.564725937Z [2024-02-23 03:18:02,564: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:18:02.566091155Z [2024-02-23 03:18:02,565: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:18:02.566145074Z [2024-02-23 03:18:02,566: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:18:02.566325515Z [2024-02-23 03:18:02,566: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:18:02.566431140Z [2024-02-23 03:18:02,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:18:02.566742924Z [2024-02-23 03:18:02,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:18:02.567401570Z [2024-02-23 03:18:02,566: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:18:02.653409251Z [2024-02-23 03:18:02,653: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:18:02.691281769Z [2024-02-23 03:18:02,690: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:18:02.695049755Z [2024-02-23 03:18:02,694: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:18:02.716175555Z [2024-02-23 03:18:02,715: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:18:02.717342806Z [2024-02-23 03:18:02,717: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:18:02.717360713Z [2024-02-23 03:18:02,717: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:18:02.717536539Z [2024-02-23 03:18:02,717: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:18:02.717627270Z [2024-02-23 03:18:02,717: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:18:02.717891704Z [2024-02-23 03:18:02,717: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:18:02.717957393Z [2024-02-23 03:18:02,717: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:18:02.850684528Z [2024-02-23 03:18:02,850: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:18:05.029240142Z [2024-02-23 03:18:05,028: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef06028c-a33f-4428-b6f4-584bbd7ecbf4] succeeded in 4.385060996999528s: None 2024-02-23T03:18:05.372106753Z [2024-02-23 03:18:05,371: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c98943e9-3229-4cb4-8edc-12edb9880774] succeeded in 4.744114574999912s: None 2024-02-23T03:19:01.105229420Z [2024-02-23 03:19:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[852aaf28-f820-4cdb-bf69-39453ee89fbf] received 2024-02-23T03:19:01.111381191Z [2024-02-23 03:19:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[608ae99e-50be-42c2-b0b0-77bf66cb15d4] received 2024-02-23T03:19:01.113115422Z [2024-02-23 03:19:01,112: INFO/ForkPoolWorker-15] [852aaf28-f820-4cdb-bf69-39453ee89fbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:19:01.123452971Z [2024-02-23 03:19:01,123: INFO/ForkPoolWorker-16] [608ae99e-50be-42c2-b0b0-77bf66cb15d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:19:01.138528799Z [2024-02-23 03:19:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f8e83f7-a0ad-4acd-891a-3956e419eb7e] received 2024-02-23T03:19:01.153471546Z [2024-02-23 03:19:01,153: INFO/ForkPoolWorker-1] [2f8e83f7-a0ad-4acd-891a-3956e419eb7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:19:01.462883601Z [2024-02-23 03:19:01,460: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:19:01.615468081Z [2024-02-23 03:19:01,614: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:19:01.619690357Z [2024-02-23 03:19:01,619: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:19:01.625811701Z [2024-02-23 03:19:01,622: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:19:01.679393685Z [2024-02-23 03:19:01,679: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:19:01.680689418Z [2024-02-23 03:19:01,680: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:19:01.680735069Z [2024-02-23 03:19:01,680: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:19:01.680783608Z [2024-02-23 03:19:01,680: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:19:01.680955669Z [2024-02-23 03:19:01,680: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:19:01.723264724Z [2024-02-23 03:19:01,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:19:01.941543271Z [2024-02-23 03:19:01,941: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:19:02.710792912Z [2024-02-23 03:19:02,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[852aaf28-f820-4cdb-bf69-39453ee89fbf] succeeded in 1.6041292949994386s: None 2024-02-23T03:19:03.065576167Z [2024-02-23 03:19:03,065: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:19:03.069274918Z [2024-02-23 03:19:03,068: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:19:03.087014351Z [2024-02-23 03:19:03,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:19:03.088897875Z [2024-02-23 03:19:03,088: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:19:03.091088809Z [2024-02-23 03:19:03,088: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:19:03.092496059Z [2024-02-23 03:19:03,092: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:19:03.092696238Z [2024-02-23 03:19:03,092: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:19:03.093887626Z [2024-02-23 03:19:03,093: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:19:03.094047120Z [2024-02-23 03:19:03,093: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:19:03.136599100Z [2024-02-23 03:19:03,136: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:19:03.139825898Z [2024-02-23 03:19:03,139: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:19:03.172973175Z [2024-02-23 03:19:03,172: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:19:03.175713146Z [2024-02-23 03:19:03,175: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:19:03.175838548Z [2024-02-23 03:19:03,175: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:19:03.176085949Z [2024-02-23 03:19:03,175: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:19:03.176216229Z [2024-02-23 03:19:03,176: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:19:03.177073321Z [2024-02-23 03:19:03,176: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:19:03.177241246Z [2024-02-23 03:19:03,177: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:19:03.186995288Z [2024-02-23 03:19:03,186: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:19:03.289396827Z [2024-02-23 03:19:03,289: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:19:06.007232853Z [2024-02-23 03:19:06,006: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f8e83f7-a0ad-4acd-891a-3956e419eb7e] succeeded in 4.866824581999026s: None 2024-02-23T03:19:06.848601689Z [2024-02-23 03:19:06,848: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[608ae99e-50be-42c2-b0b0-77bf66cb15d4] succeeded in 5.735745523999867s: None 2024-02-23T03:20:00.563651573Z [2024-02-23 03:20:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbdf68d6-f91f-4c08-9953-9050a7149677] received 2024-02-23T03:20:00.567557405Z [2024-02-23 03:20:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f33c972-2ea4-45d4-b0ae-c075f3cf8a8c] received 2024-02-23T03:20:00.569617700Z [2024-02-23 03:20:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1eb139d3-75e7-45f3-b611-11af2c9f50bb] received 2024-02-23T03:20:00.571711927Z [2024-02-23 03:20:00,571: INFO/ForkPoolWorker-15] [cbdf68d6-f91f-4c08-9953-9050a7149677] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:20:00.577863525Z [2024-02-23 03:20:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20516a77-17ad-43eb-ae89-484ffb6ccee4] received 2024-02-23T03:20:00.578215164Z [2024-02-23 03:20:00,578: INFO/ForkPoolWorker-1] [1eb139d3-75e7-45f3-b611-11af2c9f50bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:20:00.582929346Z [2024-02-23 03:20:00,579: INFO/ForkPoolWorker-16] [4f33c972-2ea4-45d4-b0ae-c075f3cf8a8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:20:00.593293892Z [2024-02-23 03:20:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85d14c2d-68b5-453a-aa1f-b22e231a0daf] received 2024-02-23T03:20:00.600065749Z [2024-02-23 03:20:00,599: INFO/ForkPoolWorker-2] [20516a77-17ad-43eb-ae89-484ffb6ccee4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:20:00.609175106Z [2024-02-23 03:20:00,608: INFO/ForkPoolWorker-3] [85d14c2d-68b5-453a-aa1f-b22e231a0daf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:20:00.919271218Z [2024-02-23 03:20:00,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:20:00.952107686Z [2024-02-23 03:20:00,948: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:20:01.095896827Z [2024-02-23 03:20:01,095: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:20:01.099888768Z [2024-02-23 03:20:01,099: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:01.148521181Z [2024-02-23 03:20:01,148: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:20:01.160243551Z [2024-02-23 03:20:01,159: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:20:01.160274104Z [2024-02-23 03:20:01,160: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:20:01.160310123Z [2024-02-23 03:20:01,160: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:20:01.160494344Z [2024-02-23 03:20:01,160: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:20:01.214028922Z [2024-02-23 03:20:01,209: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:20:01.295948291Z [2024-02-23 03:20:01,292: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:20:01.344966767Z [2024-02-23 03:20:01,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:01.517763140Z [2024-02-23 03:20:01,509: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:20:01.959207400Z [2024-02-23 03:20:01,958: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:02.546630358Z [2024-02-23 03:20:02,546: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbdf68d6-f91f-4c08-9953-9050a7149677] succeeded in 1.9817511290002585s: None 2024-02-23T03:20:02.669384564Z [2024-02-23 03:20:02,668: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:20:02.672873131Z [2024-02-23 03:20:02,672: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:02.698571925Z [2024-02-23 03:20:02,698: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:20:02.699829179Z [2024-02-23 03:20:02,699: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:20:02.699953025Z [2024-02-23 03:20:02,699: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:20:02.700405718Z [2024-02-23 03:20:02,700: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:20:02.700566136Z [2024-02-23 03:20:02,700: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:20:02.700919114Z [2024-02-23 03:20:02,700: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:20:02.701165521Z [2024-02-23 03:20:02,701: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:20:02.808008518Z [2024-02-23 03:20:02,807: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[85d14c2d-68b5-453a-aa1f-b22e231a0daf] succeeded in 2.2149824439984513s: None 2024-02-23T03:20:02.815191121Z [2024-02-23 03:20:02,814: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:02.923307665Z [2024-02-23 03:20:02,922: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:20:02.927056676Z [2024-02-23 03:20:02,926: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:02.988001290Z [2024-02-23 03:20:02,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:20:02.997759002Z [2024-02-23 03:20:02,997: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:20:02.997811506Z [2024-02-23 03:20:02,997: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:20:02.998449456Z [2024-02-23 03:20:02,997: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:20:02.998975909Z [2024-02-23 03:20:02,998: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:20:02.999541658Z [2024-02-23 03:20:02,999: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:20:02.999633195Z [2024-02-23 03:20:02,999: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:20:03.094553912Z [2024-02-23 03:20:03,094: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:03.206630862Z [2024-02-23 03:20:03,206: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:20:03.209990414Z [2024-02-23 03:20:03,209: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:03.227510160Z [2024-02-23 03:20:03,227: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:20:03.231106445Z [2024-02-23 03:20:03,230: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:20:03.231282064Z [2024-02-23 03:20:03,231: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:20:03.231457317Z [2024-02-23 03:20:03,231: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:20:03.231552931Z [2024-02-23 03:20:03,231: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:20:03.231878827Z [2024-02-23 03:20:03,231: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:20:03.231992909Z [2024-02-23 03:20:03,231: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:20:03.318630787Z [2024-02-23 03:20:03,318: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:03.706260727Z [2024-02-23 03:20:03,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f33c972-2ea4-45d4-b0ae-c075f3cf8a8c] succeeded in 3.1373253879992262s: None 2024-02-23T03:20:04.037467329Z [2024-02-23 03:20:04,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79e1ddb1-5e20-4925-86bb-275355749620] received 2024-02-23T03:20:04.045416110Z [2024-02-23 03:20:04,044: INFO/ForkPoolWorker-15] [79e1ddb1-5e20-4925-86bb-275355749620] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:20:04.367981369Z [2024-02-23 03:20:04,364: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:20:04.998604127Z [2024-02-23 03:20:04,998: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[20516a77-17ad-43eb-ae89-484ffb6ccee4] succeeded in 4.410283998000523s: None 2024-02-23T03:20:05.738289538Z [2024-02-23 03:20:05,737: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1eb139d3-75e7-45f3-b611-11af2c9f50bb] succeeded in 5.16707977400074s: None 2024-02-23T03:20:05.740375641Z [2024-02-23 03:20:05,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:20:05.743916777Z [2024-02-23 03:20:05,743: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:05.784132464Z [2024-02-23 03:20:05,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:20:05.786519902Z [2024-02-23 03:20:05,786: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:20:05.786535424Z [2024-02-23 03:20:05,786: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:20:05.786887041Z [2024-02-23 03:20:05,786: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:20:05.787457722Z [2024-02-23 03:20:05,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:20:05.787876456Z [2024-02-23 03:20:05,787: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:20:05.787969463Z [2024-02-23 03:20:05,787: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:20:05.907772756Z [2024-02-23 03:20:05,907: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:06.664402345Z [2024-02-23 03:20:06,663: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79e1ddb1-5e20-4925-86bb-275355749620] succeeded in 2.62466996799958s: None 2024-02-23T03:20:07.290378992Z [2024-02-23 03:20:07,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56e415cc-9aed-4bab-a627-f5ea592c5e72] received 2024-02-23T03:20:07.301665072Z [2024-02-23 03:20:07,301: INFO/ForkPoolWorker-15] [56e415cc-9aed-4bab-a627-f5ea592c5e72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:20:07.633709296Z [2024-02-23 03:20:07,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:20:08.801850034Z [2024-02-23 03:20:08,801: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:20:08.804867791Z [2024-02-23 03:20:08,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:08.821776153Z [2024-02-23 03:20:08,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:20:08.822979575Z [2024-02-23 03:20:08,822: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:20:08.823062755Z [2024-02-23 03:20:08,822: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:20:08.823154233Z [2024-02-23 03:20:08,822: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:20:08.823211864Z [2024-02-23 03:20:08,823: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:20:08.823477979Z [2024-02-23 03:20:08,823: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:20:08.823561643Z [2024-02-23 03:20:08,823: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:20:08.916456287Z [2024-02-23 03:20:08,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:09.487227574Z [2024-02-23 03:20:09,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56e415cc-9aed-4bab-a627-f5ea592c5e72] succeeded in 2.1909069289995386s: None 2024-02-23T03:20:10.347916200Z [2024-02-23 03:20:10,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c42878b0-a4d9-4e29-b698-e8e0d0235369] received 2024-02-23T03:20:10.356321292Z [2024-02-23 03:20:10,355: INFO/ForkPoolWorker-15] [c42878b0-a4d9-4e29-b698-e8e0d0235369] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:20:10.700465500Z [2024-02-23 03:20:10,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:20:11.810023427Z [2024-02-23 03:20:11,809: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:20:11.813238219Z [2024-02-23 03:20:11,812: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:20:11.833576744Z [2024-02-23 03:20:11,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:20:11.834815575Z [2024-02-23 03:20:11,834: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:20:11.834866128Z [2024-02-23 03:20:11,834: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:20:11.835042971Z [2024-02-23 03:20:11,834: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:20:11.835081890Z [2024-02-23 03:20:11,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:20:11.835363007Z [2024-02-23 03:20:11,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:20:11.835487671Z [2024-02-23 03:20:11,835: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:20:11.925521174Z [2024-02-23 03:20:11,925: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:20:12.550519200Z [2024-02-23 03:20:12,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c42878b0-a4d9-4e29-b698-e8e0d0235369] succeeded in 2.1993213340010698s: None 2024-02-23T03:21:01.279386678Z [2024-02-23 03:21:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[565bf9dd-5d80-4446-87e5-daa38aa8563d] received 2024-02-23T03:21:01.280809522Z [2024-02-23 03:21:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b09a659-1b4c-4b5c-a74f-7d28e27f6372] received 2024-02-23T03:21:01.285694174Z [2024-02-23 03:21:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a60b31b7-346e-4972-ae03-0f49eba7ca59] received 2024-02-23T03:21:01.293100043Z [2024-02-23 03:21:01,292: INFO/ForkPoolWorker-16] [7b09a659-1b4c-4b5c-a74f-7d28e27f6372] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:21:01.294437625Z [2024-02-23 03:21:01,293: INFO/ForkPoolWorker-15] [565bf9dd-5d80-4446-87e5-daa38aa8563d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:21:01.294742009Z [2024-02-23 03:21:01,294: INFO/ForkPoolWorker-1] [a60b31b7-346e-4972-ae03-0f49eba7ca59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:21:01.710935573Z [2024-02-23 03:21:01,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:21:01.730084034Z [2024-02-23 03:21:01,726: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:21:01.848323292Z [2024-02-23 03:21:01,837: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:21:02.065595404Z [2024-02-23 03:21:02,065: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:21:02.069490557Z [2024-02-23 03:21:02,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:21:02.095346180Z [2024-02-23 03:21:02,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:21:02.097280336Z [2024-02-23 03:21:02,097: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:21:02.097576581Z [2024-02-23 03:21:02,097: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:21:02.097860031Z [2024-02-23 03:21:02,097: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:21:02.098522473Z [2024-02-23 03:21:02,098: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:21:02.192828582Z [2024-02-23 03:21:02,192: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:21:03.017556905Z [2024-02-23 03:21:03,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[565bf9dd-5d80-4446-87e5-daa38aa8563d] succeeded in 1.7352182929989795s: None 2024-02-23T03:21:03.322944827Z [2024-02-23 03:21:03,316: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:21:03.323030474Z [2024-02-23 03:21:03,320: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:21:03.346963029Z [2024-02-23 03:21:03,345: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:21:03.347411993Z [2024-02-23 03:21:03,346: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:21:03.347438548Z [2024-02-23 03:21:03,347: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:21:03.347442977Z [2024-02-23 03:21:03,347: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:21:03.347447328Z [2024-02-23 03:21:03,347: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:21:03.349321792Z [2024-02-23 03:21:03,347: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:21:03.349334916Z [2024-02-23 03:21:03,347: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:21:03.359061473Z [2024-02-23 03:21:03,357: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:21:03.362272710Z [2024-02-23 03:21:03,361: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:21:03.396031576Z [2024-02-23 03:21:03,395: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:21:03.399177793Z [2024-02-23 03:21:03,398: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:21:03.399200662Z [2024-02-23 03:21:03,399: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:21:03.399345386Z [2024-02-23 03:21:03,399: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:21:03.399400630Z [2024-02-23 03:21:03,399: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:21:03.399766992Z [2024-02-23 03:21:03,399: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:21:03.399776661Z [2024-02-23 03:21:03,399: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:21:03.454570688Z [2024-02-23 03:21:03,453: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:21:03.519020687Z [2024-02-23 03:21:03,518: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:21:05.968687120Z [2024-02-23 03:21:05,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b09a659-1b4c-4b5c-a74f-7d28e27f6372] succeeded in 4.685637089998636s: None 2024-02-23T03:21:06.670744150Z [2024-02-23 03:21:06,670: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a60b31b7-346e-4972-ae03-0f49eba7ca59] succeeded in 5.382804308999766s: None 2024-02-23T03:22:00.354229822Z [2024-02-23 03:22:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[591529b7-b4d8-47c3-8c1b-d536fc4a1bb6] received 2024-02-23T03:22:00.356068377Z [2024-02-23 03:22:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4667912d-e99f-4d5c-9a6d-363a8a0ce243] received 2024-02-23T03:22:00.363499235Z [2024-02-23 03:22:00,363: INFO/ForkPoolWorker-16] [4667912d-e99f-4d5c-9a6d-363a8a0ce243] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:22:00.366897612Z [2024-02-23 03:22:00,366: INFO/ForkPoolWorker-15] [591529b7-b4d8-47c3-8c1b-d536fc4a1bb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:22:00.376281368Z [2024-02-23 03:22:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67056765-0c63-4bbd-b5a0-8f6b5020af41] received 2024-02-23T03:22:00.383941245Z [2024-02-23 03:22:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbf2e0eb-9457-4fbb-9704-98954dd921f7] received 2024-02-23T03:22:00.398509581Z [2024-02-23 03:22:00,398: INFO/ForkPoolWorker-2] [cbf2e0eb-9457-4fbb-9704-98954dd921f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:22:00.406243873Z [2024-02-23 03:22:00,405: INFO/ForkPoolWorker-1] [67056765-0c63-4bbd-b5a0-8f6b5020af41] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:22:00.663951064Z [2024-02-23 03:22:00,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:22:00.756916696Z [2024-02-23 03:22:00,753: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:22:00.777184249Z [2024-02-23 03:22:00,773: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:22:00.824616898Z [2024-02-23 03:22:00,821: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:22:01.015020757Z [2024-02-23 03:22:01,014: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:22:01.021078134Z [2024-02-23 03:22:01,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:22:01.059663099Z [2024-02-23 03:22:01,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:22:01.064053214Z [2024-02-23 03:22:01,063: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:22:01.064221705Z [2024-02-23 03:22:01,063: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:22:01.064408598Z [2024-02-23 03:22:01,064: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:22:01.064847577Z [2024-02-23 03:22:01,064: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:22:01.147399385Z [2024-02-23 03:22:01,147: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:22:01.212676859Z [2024-02-23 03:22:01,212: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:22:01.798602415Z [2024-02-23 03:22:01,798: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67056765-0c63-4bbd-b5a0-8f6b5020af41] succeeded in 1.4198524640014512s: None 2024-02-23T03:22:02.013315081Z [2024-02-23 03:22:02,012: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4667912d-e99f-4d5c-9a6d-363a8a0ce243] succeeded in 1.6559032370005298s: None 2024-02-23T03:22:02.159698367Z [2024-02-23 03:22:02,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:22:02.163382406Z [2024-02-23 03:22:02,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:22:02.190519880Z [2024-02-23 03:22:02,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:22:02.192524757Z [2024-02-23 03:22:02,192: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:22:02.192549537Z [2024-02-23 03:22:02,192: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:22:02.192722944Z [2024-02-23 03:22:02,192: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:22:02.192818393Z [2024-02-23 03:22:02,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:22:02.193169113Z [2024-02-23 03:22:02,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:22:02.193305004Z [2024-02-23 03:22:02,193: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:22:02.243250634Z [2024-02-23 03:22:02,242: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:22:02.247372015Z [2024-02-23 03:22:02,246: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:22:02.277984753Z [2024-02-23 03:22:02,277: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:22:02.282124524Z [2024-02-23 03:22:02,281: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:22:02.282375707Z [2024-02-23 03:22:02,282: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:22:02.282707414Z [2024-02-23 03:22:02,282: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:22:02.283001679Z [2024-02-23 03:22:02,282: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:22:02.283688859Z [2024-02-23 03:22:02,283: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:22:02.283820854Z [2024-02-23 03:22:02,283: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:22:02.288532076Z [2024-02-23 03:22:02,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:22:02.382397746Z [2024-02-23 03:22:02,382: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:22:04.823525486Z [2024-02-23 03:22:04,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[591529b7-b4d8-47c3-8c1b-d536fc4a1bb6] succeeded in 4.465783267000006s: None 2024-02-23T03:22:05.625042378Z [2024-02-23 03:22:05,624: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cbf2e0eb-9457-4fbb-9704-98954dd921f7] succeeded in 5.236626230998809s: None 2024-02-23T03:23:00.480810180Z [2024-02-23 03:23:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c5fde0-59f5-4b0d-9c47-962b70060804] received 2024-02-23T03:23:00.482876706Z [2024-02-23 03:23:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[055dfee3-f0d9-40fa-b455-03e6b01320d5] received 2024-02-23T03:23:00.489402502Z [2024-02-23 03:23:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04fc14c2-0d47-4c08-9079-f3fc30129473] received 2024-02-23T03:23:00.490410496Z [2024-02-23 03:23:00,490: INFO/ForkPoolWorker-15] [97c5fde0-59f5-4b0d-9c47-962b70060804] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:23:00.499727591Z [2024-02-23 03:23:00,499: INFO/ForkPoolWorker-16] [055dfee3-f0d9-40fa-b455-03e6b01320d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:23:00.501081052Z [2024-02-23 03:23:00,500: INFO/ForkPoolWorker-1] [04fc14c2-0d47-4c08-9079-f3fc30129473] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:23:00.860606726Z [2024-02-23 03:23:00,857: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:23:01.011010523Z [2024-02-23 03:23:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:23:01.033184575Z [2024-02-23 03:23:01,032: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:23:01.037182244Z [2024-02-23 03:23:01,036: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:23:01.090093984Z [2024-02-23 03:23:01,089: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:23:01.091094609Z [2024-02-23 03:23:01,090: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:23:01.091187163Z [2024-02-23 03:23:01,091: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:23:01.091249956Z [2024-02-23 03:23:01,091: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:23:01.091472756Z [2024-02-23 03:23:01,091: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:23:01.124243172Z [2024-02-23 03:23:01,120: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:23:01.254127652Z [2024-02-23 03:23:01,253: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:23:01.918937796Z [2024-02-23 03:23:01,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04fc14c2-0d47-4c08-9079-f3fc30129473] succeeded in 1.4266818260002765s: None 2024-02-23T03:23:02.354005335Z [2024-02-23 03:23:02,353: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:23:02.357947645Z [2024-02-23 03:23:02,357: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:23:02.416833902Z [2024-02-23 03:23:02,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:23:02.419238017Z [2024-02-23 03:23:02,418: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:23:02.419264337Z [2024-02-23 03:23:02,418: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:23:02.419290925Z [2024-02-23 03:23:02,418: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:23:02.419297093Z [2024-02-23 03:23:02,418: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:23:02.419301116Z [2024-02-23 03:23:02,418: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:23:02.419305133Z [2024-02-23 03:23:02,419: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:23:02.507400224Z [2024-02-23 03:23:02,506: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:23:02.516185369Z [2024-02-23 03:23:02,515: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:23:02.545093734Z [2024-02-23 03:23:02,544: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:23:02.573107137Z [2024-02-23 03:23:02,572: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:23:02.575503967Z [2024-02-23 03:23:02,575: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:23:02.575576315Z [2024-02-23 03:23:02,575: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:23:02.575762147Z [2024-02-23 03:23:02,575: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:23:02.575836759Z [2024-02-23 03:23:02,575: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:23:02.576266074Z [2024-02-23 03:23:02,576: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:23:02.576359069Z [2024-02-23 03:23:02,576: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:23:02.678994704Z [2024-02-23 03:23:02,678: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:23:04.303700307Z [2024-02-23 03:23:04,303: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97c5fde0-59f5-4b0d-9c47-962b70060804] succeeded in 3.8209678869989148s: None 2024-02-23T03:23:04.862395920Z [2024-02-23 03:23:04,861: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[055dfee3-f0d9-40fa-b455-03e6b01320d5] succeeded in 4.3757245110009535s: None 2024-02-23T03:24:00.619404166Z [2024-02-23 03:24:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1136b9e8-6417-437b-beeb-02f554d891fa] received 2024-02-23T03:24:00.624410973Z [2024-02-23 03:24:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5927bfe-7999-4792-ae25-59b56923e271] received 2024-02-23T03:24:00.630575715Z [2024-02-23 03:24:00,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[284d2487-ee80-4b7e-83c9-01b82a0c1568] received 2024-02-23T03:24:00.633116574Z [2024-02-23 03:24:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64c4b05a-a544-4933-81c1-6827d89e893d] received 2024-02-23T03:24:00.637382365Z [2024-02-23 03:24:00,637: INFO/ForkPoolWorker-16] [e5927bfe-7999-4792-ae25-59b56923e271] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:24:00.638537141Z [2024-02-23 03:24:00,638: INFO/ForkPoolWorker-15] [1136b9e8-6417-437b-beeb-02f554d891fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:24:00.641817796Z [2024-02-23 03:24:00,641: INFO/ForkPoolWorker-1] [284d2487-ee80-4b7e-83c9-01b82a0c1568] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:24:00.650554466Z [2024-02-23 03:24:00,650: INFO/ForkPoolWorker-2] [64c4b05a-a544-4933-81c1-6827d89e893d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:24:00.963246027Z [2024-02-23 03:24:00,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:24:00.979499892Z [2024-02-23 03:24:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:24:00.993389994Z [2024-02-23 03:24:00,990: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:24:01.109042623Z [2024-02-23 03:24:01,105: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:24:01.265365021Z [2024-02-23 03:24:01,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:24:01.312836928Z [2024-02-23 03:24:01,312: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:24:01.317817126Z [2024-02-23 03:24:01,317: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:24:01.349296800Z [2024-02-23 03:24:01,349: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:24:01.350268914Z [2024-02-23 03:24:01,350: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:24:01.350381807Z [2024-02-23 03:24:01,350: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:24:01.350476332Z [2024-02-23 03:24:01,350: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:24:01.350758180Z [2024-02-23 03:24:01,350: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:24:01.473469860Z [2024-02-23 03:24:01,473: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:24:01.877346554Z [2024-02-23 03:24:01,876: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1136b9e8-6417-437b-beeb-02f554d891fa] succeeded in 1.2540046400008578s: None 2024-02-23T03:24:02.151461645Z [2024-02-23 03:24:02,150: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[64c4b05a-a544-4933-81c1-6827d89e893d] succeeded in 1.512679591000051s: None 2024-02-23T03:24:02.338405916Z [2024-02-23 03:24:02,338: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:24:02.341816263Z [2024-02-23 03:24:02,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:24:02.366957603Z [2024-02-23 03:24:02,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:24:02.369019245Z [2024-02-23 03:24:02,368: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:24:02.369053686Z [2024-02-23 03:24:02,368: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:24:02.369308236Z [2024-02-23 03:24:02,369: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:24:02.369418248Z [2024-02-23 03:24:02,369: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:24:02.369802310Z [2024-02-23 03:24:02,369: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:24:02.369974732Z [2024-02-23 03:24:02,369: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:24:02.393746087Z [2024-02-23 03:24:02,393: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:24:02.398775332Z [2024-02-23 03:24:02,398: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:24:02.418188139Z [2024-02-23 03:24:02,417: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:24:02.419965108Z [2024-02-23 03:24:02,419: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:24:02.420107818Z [2024-02-23 03:24:02,419: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:24:02.421142173Z [2024-02-23 03:24:02,420: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:24:02.421165813Z [2024-02-23 03:24:02,421: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:24:02.421470037Z [2024-02-23 03:24:02,421: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:24:02.421607646Z [2024-02-23 03:24:02,421: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:24:02.487991285Z [2024-02-23 03:24:02,487: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:24:02.527861252Z [2024-02-23 03:24:02,527: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:24:04.165716845Z [2024-02-23 03:24:04,165: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[284d2487-ee80-4b7e-83c9-01b82a0c1568] succeeded in 3.5327797049994842s: None 2024-02-23T03:24:05.455254322Z [2024-02-23 03:24:05,454: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5927bfe-7999-4792-ae25-59b56923e271] succeeded in 4.827637377000428s: None 2024-02-23T03:25:00.593678599Z [2024-02-23 03:25:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcdba0e5-1a8f-4396-b10b-51d77ea69f38] received 2024-02-23T03:25:00.598270363Z [2024-02-23 03:25:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d56e3896-8b34-4435-b170-ea7a23b4683d] received 2024-02-23T03:25:00.601063677Z [2024-02-23 03:25:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[822bd44a-8019-4f47-a027-11e3999d6ac5] received 2024-02-23T03:25:00.605121495Z [2024-02-23 03:25:00,604: INFO/ForkPoolWorker-15] [bcdba0e5-1a8f-4396-b10b-51d77ea69f38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:25:00.607999679Z [2024-02-23 03:25:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[252eb36b-df58-449d-ade7-11deece106b1] received 2024-02-23T03:25:00.614306515Z [2024-02-23 03:25:00,614: INFO/ForkPoolWorker-16] [d56e3896-8b34-4435-b170-ea7a23b4683d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:25:00.622373501Z [2024-02-23 03:25:00,622: INFO/ForkPoolWorker-1] [822bd44a-8019-4f47-a027-11e3999d6ac5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:25:00.624072885Z [2024-02-23 03:25:00,623: INFO/ForkPoolWorker-2] [252eb36b-df58-449d-ade7-11deece106b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:25:01.054669884Z [2024-02-23 03:25:01,051: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:25:01.078995449Z [2024-02-23 03:25:01,072: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:25:01.249560448Z [2024-02-23 03:25:01,246: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:25:01.275668630Z [2024-02-23 03:25:01,263: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:25:01.655989477Z [2024-02-23 03:25:01,655: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:25:01.664440522Z [2024-02-23 03:25:01,663: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:01.767519949Z [2024-02-23 03:25:01,767: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:25:01.769087884Z [2024-02-23 03:25:01,768: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:25:01.769319502Z [2024-02-23 03:25:01,768: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:25:01.769382109Z [2024-02-23 03:25:01,769: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:25:01.769801241Z [2024-02-23 03:25:01,769: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:25:01.975272136Z [2024-02-23 03:25:01,975: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:02.798194906Z [2024-02-23 03:25:02,797: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[252eb36b-df58-449d-ade7-11deece106b1] succeeded in 2.1877433500012557s: None 2024-02-23T03:25:03.446064829Z [2024-02-23 03:25:03,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:25:03.451014477Z [2024-02-23 03:25:03,449: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:03.467314063Z [2024-02-23 03:25:03,466: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:25:03.471331586Z [2024-02-23 03:25:03,470: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:03.504577156Z [2024-02-23 03:25:03,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:25:03.506746483Z [2024-02-23 03:25:03,506: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:25:03.507186166Z [2024-02-23 03:25:03,507: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:25:03.507740152Z [2024-02-23 03:25:03,507: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:25:03.508943203Z [2024-02-23 03:25:03,508: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:25:03.509487274Z [2024-02-23 03:25:03,509: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:25:03.509619121Z [2024-02-23 03:25:03,509: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:25:03.510324193Z [2024-02-23 03:25:03,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:25:03.511595289Z [2024-02-23 03:25:03,511: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:25:03.511609375Z [2024-02-23 03:25:03,511: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:25:03.511735388Z [2024-02-23 03:25:03,511: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:25:03.511741693Z [2024-02-23 03:25:03,511: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:25:03.512000549Z [2024-02-23 03:25:03,511: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:25:03.512082249Z [2024-02-23 03:25:03,512: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:25:03.607462874Z [2024-02-23 03:25:03,607: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:03.625411362Z [2024-02-23 03:25:03,625: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:03.701879873Z [2024-02-23 03:25:03,701: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:25:03.707777790Z [2024-02-23 03:25:03,707: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:03.788431671Z [2024-02-23 03:25:03,788: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:25:03.789736226Z [2024-02-23 03:25:03,789: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:25:03.790255271Z [2024-02-23 03:25:03,789: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:25:03.790472744Z [2024-02-23 03:25:03,790: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:25:03.790588460Z [2024-02-23 03:25:03,790: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:25:03.791048646Z [2024-02-23 03:25:03,790: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:25:03.791185630Z [2024-02-23 03:25:03,791: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:25:03.925872364Z [2024-02-23 03:25:03,925: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:04.419777026Z [2024-02-23 03:25:04,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e15195b-fbe1-4438-a9a4-4d718c68dc36] received 2024-02-23T03:25:04.426073702Z [2024-02-23 03:25:04,425: INFO/ForkPoolWorker-2] [8e15195b-fbe1-4438-a9a4-4d718c68dc36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:25:04.437240165Z [2024-02-23 03:25:04,436: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bcdba0e5-1a8f-4396-b10b-51d77ea69f38] succeeded in 3.84036330500021s: None 2024-02-23T03:25:04.737509889Z [2024-02-23 03:25:04,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:25:05.468581332Z [2024-02-23 03:25:05,468: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d56e3896-8b34-4435-b170-ea7a23b4683d] succeeded in 4.864576395000768s: None 2024-02-23T03:25:05.941490959Z [2024-02-23 03:25:05,940: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[822bd44a-8019-4f47-a027-11e3999d6ac5] succeeded in 5.337726059999113s: None 2024-02-23T03:25:06.116614154Z [2024-02-23 03:25:06,116: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:25:06.119856756Z [2024-02-23 03:25:06,119: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:06.141876036Z [2024-02-23 03:25:06,141: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:25:06.143540240Z [2024-02-23 03:25:06,143: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:25:06.143747632Z [2024-02-23 03:25:06,143: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:25:06.144062408Z [2024-02-23 03:25:06,143: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:25:06.144151803Z [2024-02-23 03:25:06,144: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:25:06.144381153Z [2024-02-23 03:25:06,144: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:25:06.144773240Z [2024-02-23 03:25:06,144: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:25:06.265082928Z [2024-02-23 03:25:06,264: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:06.873004510Z [2024-02-23 03:25:06,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2c1714-c5f1-42a9-ab3c-dbac60260bd3] received 2024-02-23T03:25:06.891785679Z [2024-02-23 03:25:06,891: INFO/ForkPoolWorker-15] [0a2c1714-c5f1-42a9-ab3c-dbac60260bd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:25:06.980725105Z [2024-02-23 03:25:06,979: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e15195b-fbe1-4438-a9a4-4d718c68dc36] succeeded in 2.559922808999545s: None 2024-02-23T03:25:07.271313300Z [2024-02-23 03:25:07,267: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:25:08.583805621Z [2024-02-23 03:25:08,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:25:08.587186989Z [2024-02-23 03:25:08,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:08.606238676Z [2024-02-23 03:25:08,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:25:08.607887604Z [2024-02-23 03:25:08,607: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:25:08.609067433Z [2024-02-23 03:25:08,607: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:25:08.609081375Z [2024-02-23 03:25:08,607: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:25:08.609086019Z [2024-02-23 03:25:08,608: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:25:08.609089690Z [2024-02-23 03:25:08,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:25:08.609093691Z [2024-02-23 03:25:08,608: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:25:08.715175484Z [2024-02-23 03:25:08,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:09.345033395Z [2024-02-23 03:25:09,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a2c1714-c5f1-42a9-ab3c-dbac60260bd3] succeeded in 2.4690883179991943s: None 2024-02-23T03:25:09.591450668Z [2024-02-23 03:25:09,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8852c0ba-1e93-42a5-a0b3-3870e61dde7c] received 2024-02-23T03:25:09.606285001Z [2024-02-23 03:25:09,605: INFO/ForkPoolWorker-15] [8852c0ba-1e93-42a5-a0b3-3870e61dde7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:25:09.938311746Z [2024-02-23 03:25:09,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:25:11.076280875Z [2024-02-23 03:25:11,075: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:25:11.079601894Z [2024-02-23 03:25:11,079: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:25:11.112130595Z [2024-02-23 03:25:11,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:25:11.113636693Z [2024-02-23 03:25:11,113: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:25:11.113753663Z [2024-02-23 03:25:11,113: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:25:11.114033102Z [2024-02-23 03:25:11,113: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:25:11.114239235Z [2024-02-23 03:25:11,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:25:11.114599677Z [2024-02-23 03:25:11,114: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:25:11.114765895Z [2024-02-23 03:25:11,114: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:25:11.226345999Z [2024-02-23 03:25:11,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:25:11.875792471Z [2024-02-23 03:25:11,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8852c0ba-1e93-42a5-a0b3-3870e61dde7c] succeeded in 2.2809925569999905s: None 2024-02-23T03:26:00.682645225Z [2024-02-23 03:26:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63c18ed3-740c-4fce-886f-cc92ddce5922] received 2024-02-23T03:26:00.685385948Z [2024-02-23 03:26:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9173bbb8-ee4b-4f8d-a1ee-b07c5f7f1b1d] received 2024-02-23T03:26:00.695898999Z [2024-02-23 03:26:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5005a0df-4508-4b78-839e-4e16d33b4435] received 2024-02-23T03:26:00.697114020Z [2024-02-23 03:26:00,696: INFO/ForkPoolWorker-16] [9173bbb8-ee4b-4f8d-a1ee-b07c5f7f1b1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:26:00.699276615Z [2024-02-23 03:26:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77bfe56d-9f0d-4ec7-a3ad-470fd9731074] received 2024-02-23T03:26:00.705223191Z [2024-02-23 03:26:00,704: INFO/ForkPoolWorker-1] [5005a0df-4508-4b78-839e-4e16d33b4435] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:26:00.709839113Z [2024-02-23 03:26:00,709: INFO/ForkPoolWorker-2] [77bfe56d-9f0d-4ec7-a3ad-470fd9731074] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:26:00.711646249Z [2024-02-23 03:26:00,711: INFO/ForkPoolWorker-15] [63c18ed3-740c-4fce-886f-cc92ddce5922] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:26:01.030584847Z [2024-02-23 03:26:01,026: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:26:01.044841519Z [2024-02-23 03:26:01,041: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:26:01.077141369Z [2024-02-23 03:26:01,073: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:26:01.206130463Z [2024-02-23 03:26:01,205: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:26:01.210221584Z [2024-02-23 03:26:01,209: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:26:01.228828306Z [2024-02-23 03:26:01,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:26:01.244880582Z [2024-02-23 03:26:01,244: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:26:01.246585187Z [2024-02-23 03:26:01,246: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:26:01.246644389Z [2024-02-23 03:26:01,246: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:26:01.246674824Z [2024-02-23 03:26:01,246: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:26:01.246933991Z [2024-02-23 03:26:01,246: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:26:01.407943571Z [2024-02-23 03:26:01,407: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:26:01.608312066Z [2024-02-23 03:26:01,607: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:26:02.230114809Z [2024-02-23 03:26:02,229: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77bfe56d-9f0d-4ec7-a3ad-470fd9731074] succeeded in 1.5289445750004234s: None 2024-02-23T03:26:02.285582512Z [2024-02-23 03:26:02,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63c18ed3-740c-4fce-886f-cc92ddce5922] succeeded in 1.5969777800000884s: None 2024-02-23T03:26:02.455844140Z [2024-02-23 03:26:02,455: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:26:02.459381972Z [2024-02-23 03:26:02,458: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:26:02.484887935Z [2024-02-23 03:26:02,484: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:26:02.487032905Z [2024-02-23 03:26:02,486: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:26:02.487210955Z [2024-02-23 03:26:02,486: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:26:02.487473613Z [2024-02-23 03:26:02,487: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:26:02.487540433Z [2024-02-23 03:26:02,487: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:26:02.488167974Z [2024-02-23 03:26:02,487: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:26:02.488208506Z [2024-02-23 03:26:02,488: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:26:02.530231961Z [2024-02-23 03:26:02,529: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:26:02.533847339Z [2024-02-23 03:26:02,533: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:26:02.566447381Z [2024-02-23 03:26:02,566: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:26:02.568508133Z [2024-02-23 03:26:02,568: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:26:02.568761530Z [2024-02-23 03:26:02,568: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:26:02.569163064Z [2024-02-23 03:26:02,568: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:26:02.569527327Z [2024-02-23 03:26:02,569: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:26:02.569869349Z [2024-02-23 03:26:02,569: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:26:02.570002475Z [2024-02-23 03:26:02,569: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:26:02.588012863Z [2024-02-23 03:26:02,587: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:26:02.683616039Z [2024-02-23 03:26:02,683: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:26:04.146141230Z [2024-02-23 03:26:04,145: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5005a0df-4508-4b78-839e-4e16d33b4435] succeeded in 3.447836217001168s: None 2024-02-23T03:26:04.908763536Z [2024-02-23 03:26:04,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9173bbb8-ee4b-4f8d-a1ee-b07c5f7f1b1d] succeeded in 4.2175361680001515s: None 2024-02-23T03:27:01.213463707Z [2024-02-23 03:27:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3089a2b-be35-4c9e-8f0f-ea61129d8141] received 2024-02-23T03:27:01.219608957Z [2024-02-23 03:27:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a4cafda-b2a5-4a5b-8bb4-27d0024d8d81] received 2024-02-23T03:27:01.222689387Z [2024-02-23 03:27:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa69e3d6-ccd4-4822-bdb8-3de861575930] received 2024-02-23T03:27:01.227500396Z [2024-02-23 03:27:01,227: INFO/ForkPoolWorker-15] [e3089a2b-be35-4c9e-8f0f-ea61129d8141] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:27:01.229744795Z [2024-02-23 03:27:01,229: INFO/ForkPoolWorker-1] [aa69e3d6-ccd4-4822-bdb8-3de861575930] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:27:01.233441771Z [2024-02-23 03:27:01,233: INFO/ForkPoolWorker-16] [3a4cafda-b2a5-4a5b-8bb4-27d0024d8d81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:27:01.528616350Z [2024-02-23 03:27:01,525: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:27:01.542358533Z [2024-02-23 03:27:01,539: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:27:01.571651148Z [2024-02-23 03:27:01,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:27:01.709183428Z [2024-02-23 03:27:01,708: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:27:01.713270600Z [2024-02-23 03:27:01,712: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:27:01.757558507Z [2024-02-23 03:27:01,757: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:27:01.759789922Z [2024-02-23 03:27:01,759: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:27:01.760622107Z [2024-02-23 03:27:01,760: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:27:01.760804435Z [2024-02-23 03:27:01,760: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:27:01.761111412Z [2024-02-23 03:27:01,760: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:27:01.855820385Z [2024-02-23 03:27:01,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:27:02.493777366Z [2024-02-23 03:27:02,493: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a4cafda-b2a5-4a5b-8bb4-27d0024d8d81] succeeded in 1.2692277480000485s: None 2024-02-23T03:27:02.732620931Z [2024-02-23 03:27:02,732: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:27:02.735819629Z [2024-02-23 03:27:02,735: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:27:02.761291322Z [2024-02-23 03:27:02,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:27:02.762729618Z [2024-02-23 03:27:02,762: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:27:02.762762122Z [2024-02-23 03:27:02,762: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:27:02.763070156Z [2024-02-23 03:27:02,762: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:27:02.763088769Z [2024-02-23 03:27:02,762: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:27:02.763458055Z [2024-02-23 03:27:02,763: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:27:02.763644431Z [2024-02-23 03:27:02,763: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:27:02.804474383Z [2024-02-23 03:27:02,803: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:27:02.807706848Z [2024-02-23 03:27:02,807: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:27:02.837198604Z [2024-02-23 03:27:02,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:27:02.838761753Z [2024-02-23 03:27:02,838: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:27:02.838809218Z [2024-02-23 03:27:02,838: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:27:02.839039062Z [2024-02-23 03:27:02,838: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:27:02.839081776Z [2024-02-23 03:27:02,838: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:27:02.839384742Z [2024-02-23 03:27:02,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:27:02.839398912Z [2024-02-23 03:27:02,839: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:27:02.866146544Z [2024-02-23 03:27:02,865: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:27:02.931324008Z [2024-02-23 03:27:02,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:27:04.433325652Z [2024-02-23 03:27:04,432: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa69e3d6-ccd4-4822-bdb8-3de861575930] succeeded in 3.208770524999636s: None 2024-02-23T03:27:05.351897741Z [2024-02-23 03:27:05,351: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3089a2b-be35-4c9e-8f0f-ea61129d8141] succeeded in 4.135053261001303s: None 2024-02-23T03:28:01.329499847Z [2024-02-23 03:28:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed2f863e-32cb-409c-95b3-6d09657fe75d] received 2024-02-23T03:28:01.334728103Z [2024-02-23 03:28:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac11e6e9-89ac-477a-9655-3ec01865ecf6] received 2024-02-23T03:28:01.337124635Z [2024-02-23 03:28:01,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf2bc5cd-2fa0-46d9-976d-43713d93c811] received 2024-02-23T03:28:01.339901445Z [2024-02-23 03:28:01,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cec931c8-6823-44d8-9c1c-bab49a821563] received 2024-02-23T03:28:01.343330318Z [2024-02-23 03:28:01,343: INFO/ForkPoolWorker-15] [ed2f863e-32cb-409c-95b3-6d09657fe75d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:28:01.349081589Z [2024-02-23 03:28:01,348: INFO/ForkPoolWorker-2] [cec931c8-6823-44d8-9c1c-bab49a821563] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:28:01.350805574Z [2024-02-23 03:28:01,350: INFO/ForkPoolWorker-1] [bf2bc5cd-2fa0-46d9-976d-43713d93c811] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:28:01.351509930Z [2024-02-23 03:28:01,351: INFO/ForkPoolWorker-16] [ac11e6e9-89ac-477a-9655-3ec01865ecf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:28:01.719301546Z [2024-02-23 03:28:01,715: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:28:01.760979448Z [2024-02-23 03:28:01,757: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:28:01.951043856Z [2024-02-23 03:28:01,950: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:28:01.956393227Z [2024-02-23 03:28:01,955: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:28:01.998089596Z [2024-02-23 03:28:01,997: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:28:01.999657354Z [2024-02-23 03:28:01,999: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:28:02.000129785Z [2024-02-23 03:28:01,999: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:28:02.000715847Z [2024-02-23 03:28:02,000: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:28:02.001258988Z [2024-02-23 03:28:02,001: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:28:02.110157083Z [2024-02-23 03:28:02,109: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:28:02.190793334Z [2024-02-23 03:28:02,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:28:02.387043871Z [2024-02-23 03:28:02,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:28:02.881200971Z [2024-02-23 03:28:02,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:28:03.087997316Z [2024-02-23 03:28:03,087: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cec931c8-6823-44d8-9c1c-bab49a821563] succeeded in 1.7459868240002834s: None 2024-02-23T03:28:03.133990801Z [2024-02-23 03:28:03,122: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:28:03.140417992Z [2024-02-23 03:28:03,139: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:28:03.163630159Z [2024-02-23 03:28:03,163: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:28:03.165440908Z [2024-02-23 03:28:03,165: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:28:03.165485728Z [2024-02-23 03:28:03,165: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:28:03.165715034Z [2024-02-23 03:28:03,165: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:28:03.165835139Z [2024-02-23 03:28:03,165: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:28:03.166381421Z [2024-02-23 03:28:03,166: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:28:03.166475354Z [2024-02-23 03:28:03,166: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:28:03.254092771Z [2024-02-23 03:28:03,253: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:28:03.776005623Z [2024-02-23 03:28:03,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed2f863e-32cb-409c-95b3-6d09657fe75d] succeeded in 2.444018654001411s: None 2024-02-23T03:28:04.485223978Z [2024-02-23 03:28:04,484: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:28:04.490269754Z [2024-02-23 03:28:04,489: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:28:04.547719369Z [2024-02-23 03:28:04,547: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:28:04.551944517Z [2024-02-23 03:28:04,551: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:28:04.551972325Z [2024-02-23 03:28:04,551: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:28:04.552385972Z [2024-02-23 03:28:04,551: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:28:04.552434027Z [2024-02-23 03:28:04,552: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:28:04.552674774Z [2024-02-23 03:28:04,552: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:28:04.552689735Z [2024-02-23 03:28:04,552: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:28:04.657767871Z [2024-02-23 03:28:04,657: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:28:05.744253602Z [2024-02-23 03:28:05,743: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf2bc5cd-2fa0-46d9-976d-43713d93c811] succeeded in 4.403360193999106s: None 2024-02-23T03:28:06.931327650Z [2024-02-23 03:28:06,930: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac11e6e9-89ac-477a-9655-3ec01865ecf6] succeeded in 5.594195394998678s: None 2024-02-23T03:29:01.042008585Z [2024-02-23 03:29:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a3b7e35-ac3f-4e35-aaa0-7a6f3f0b7f95] received 2024-02-23T03:29:01.055805852Z [2024-02-23 03:29:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0780307-8560-4e0c-86f8-1efa940e0b9c] received 2024-02-23T03:29:01.061493977Z [2024-02-23 03:29:01,061: INFO/ForkPoolWorker-15] [5a3b7e35-ac3f-4e35-aaa0-7a6f3f0b7f95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:29:01.063201944Z [2024-02-23 03:29:01,062: INFO/ForkPoolWorker-16] [e0780307-8560-4e0c-86f8-1efa940e0b9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:29:01.068218071Z [2024-02-23 03:29:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7826477e-1c85-483b-b518-502e5551f65f] received 2024-02-23T03:29:01.091362709Z [2024-02-23 03:29:01,091: INFO/ForkPoolWorker-1] [7826477e-1c85-483b-b518-502e5551f65f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:29:01.386388294Z [2024-02-23 03:29:01,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:29:01.459884894Z [2024-02-23 03:29:01,456: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:29:01.574818032Z [2024-02-23 03:29:01,571: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:29:01.748575172Z [2024-02-23 03:29:01,748: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:29:01.759391131Z [2024-02-23 03:29:01,758: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:29:01.800480234Z [2024-02-23 03:29:01,800: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:29:01.802339108Z [2024-02-23 03:29:01,801: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:29:01.802739392Z [2024-02-23 03:29:01,802: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:29:01.803334144Z [2024-02-23 03:29:01,802: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:29:01.807074362Z [2024-02-23 03:29:01,803: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:29:01.933429647Z [2024-02-23 03:29:01,933: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:29:02.613186618Z [2024-02-23 03:29:02,612: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7826477e-1c85-483b-b518-502e5551f65f] succeeded in 1.5424612750011875s: None 2024-02-23T03:29:02.665209123Z [2024-02-23 03:29:02,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:29:02.668699631Z [2024-02-23 03:29:02,668: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:29:02.669006274Z [2024-02-23 03:29:02,668: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:29:02.672526143Z [2024-02-23 03:29:02,672: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:29:02.692442988Z [2024-02-23 03:29:02,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:29:02.694084430Z [2024-02-23 03:29:02,693: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:29:02.694114374Z [2024-02-23 03:29:02,694: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:29:02.694295082Z [2024-02-23 03:29:02,694: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:29:02.694328346Z [2024-02-23 03:29:02,694: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:29:02.694607522Z [2024-02-23 03:29:02,694: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:29:02.694703692Z [2024-02-23 03:29:02,694: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:29:02.702558031Z [2024-02-23 03:29:02,702: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:29:02.704143827Z [2024-02-23 03:29:02,703: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:29:02.704187759Z [2024-02-23 03:29:02,704: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:29:02.704335674Z [2024-02-23 03:29:02,704: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:29:02.704375074Z [2024-02-23 03:29:02,704: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:29:02.704646124Z [2024-02-23 03:29:02,704: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:29:02.704718747Z [2024-02-23 03:29:02,704: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:29:02.802133590Z [2024-02-23 03:29:02,801: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:29:02.814124578Z [2024-02-23 03:29:02,813: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:29:04.536265864Z [2024-02-23 03:29:04,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a3b7e35-ac3f-4e35-aaa0-7a6f3f0b7f95] succeeded in 3.488050933001432s: None 2024-02-23T03:29:05.023322065Z [2024-02-23 03:29:05,022: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0780307-8560-4e0c-86f8-1efa940e0b9c] succeeded in 3.9654138990008505s: None 2024-02-23T03:30:01.109545086Z [2024-02-23 03:30:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f9a9406-c314-45ed-9644-9d7a7d166e71] received 2024-02-23T03:30:01.119919245Z [2024-02-23 03:30:01,119: INFO/ForkPoolWorker-15] [3f9a9406-c314-45ed-9644-9d7a7d166e71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:30:01.127323906Z [2024-02-23 03:30:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15617e8d-2629-4160-ac21-59fe4c4ea617] received 2024-02-23T03:30:01.134630771Z [2024-02-23 03:30:01,134: INFO/ForkPoolWorker-16] [15617e8d-2629-4160-ac21-59fe4c4ea617] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:30:01.140951784Z [2024-02-23 03:30:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7044b4f7-4251-4b3a-98c6-9f4ac14aafb5] received 2024-02-23T03:30:01.143412112Z [2024-02-23 03:30:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7418d30a-90ff-4f49-a2d1-dbc37fc6cc49] received 2024-02-23T03:30:01.145191075Z [2024-02-23 03:30:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9714f71c-07cc-437b-8de7-c36d016d2056] received 2024-02-23T03:30:01.153904954Z [2024-02-23 03:30:01,153: INFO/ForkPoolWorker-1] [7044b4f7-4251-4b3a-98c6-9f4ac14aafb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:30:01.155904799Z [2024-02-23 03:30:01,155: INFO/ForkPoolWorker-2] [7418d30a-90ff-4f49-a2d1-dbc37fc6cc49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:30:01.171274910Z [2024-02-23 03:30:01,170: INFO/ForkPoolWorker-3] [9714f71c-07cc-437b-8de7-c36d016d2056] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:30:01.514172285Z [2024-02-23 03:30:01,509: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:30:01.519783350Z [2024-02-23 03:30:01,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:30:01.581504090Z [2024-02-23 03:30:01,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:30:01.760479568Z [2024-02-23 03:30:01,757: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:30:01.778446263Z [2024-02-23 03:30:01,772: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:30:01.843458322Z [2024-02-23 03:30:01,843: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:01.956490030Z [2024-02-23 03:30:01,956: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T03:30:01.960784146Z [2024-02-23 03:30:01,960: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:02.006773631Z [2024-02-23 03:30:02,006: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:30:02.009074272Z [2024-02-23 03:30:02,008: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:30:02.009116568Z [2024-02-23 03:30:02,009: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:30:02.009172441Z [2024-02-23 03:30:02,009: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T03:30:02.009359384Z [2024-02-23 03:30:02,009: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:30:02.159347290Z [2024-02-23 03:30:02,159: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:02.528189585Z [2024-02-23 03:30:02,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15617e8d-2629-4160-ac21-59fe4c4ea617] succeeded in 1.3993619220000255s: None 2024-02-23T03:30:03.093443338Z [2024-02-23 03:30:03,093: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9714f71c-07cc-437b-8de7-c36d016d2056] succeeded in 1.9449222330003977s: None 2024-02-23T03:30:03.150667171Z [2024-02-23 03:30:03,150: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:30:03.153771971Z [2024-02-23 03:30:03,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:03.190508854Z [2024-02-23 03:30:03,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:30:03.191904603Z [2024-02-23 03:30:03,191: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:30:03.191994509Z [2024-02-23 03:30:03,191: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:30:03.192143861Z [2024-02-23 03:30:03,192: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:30:03.192245231Z [2024-02-23 03:30:03,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:30:03.192557012Z [2024-02-23 03:30:03,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:30:03.192638667Z [2024-02-23 03:30:03,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:30:03.301227632Z [2024-02-23 03:30:03,300: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:03.346439282Z [2024-02-23 03:30:03,345: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:30:03.349955799Z [2024-02-23 03:30:03,349: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:03.371301571Z [2024-02-23 03:30:03,371: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:30:03.372781686Z [2024-02-23 03:30:03,372: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:30:03.372933882Z [2024-02-23 03:30:03,372: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:30:03.373211627Z [2024-02-23 03:30:03,372: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:30:03.373383306Z [2024-02-23 03:30:03,373: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:30:03.373738803Z [2024-02-23 03:30:03,373: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:30:03.373883060Z [2024-02-23 03:30:03,373: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:30:03.426768536Z [2024-02-23 03:30:03,426: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:30:03.430197958Z [2024-02-23 03:30:03,429: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:03.449850491Z [2024-02-23 03:30:03,449: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:30:03.451417408Z [2024-02-23 03:30:03,451: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:30:03.451620185Z [2024-02-23 03:30:03,451: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:30:03.451827293Z [2024-02-23 03:30:03,451: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:30:03.451959019Z [2024-02-23 03:30:03,451: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:30:03.452659111Z [2024-02-23 03:30:03,452: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:30:03.452788485Z [2024-02-23 03:30:03,452: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:30:03.460986521Z [2024-02-23 03:30:03,460: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:03.544113094Z [2024-02-23 03:30:03,543: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:03.987576672Z [2024-02-23 03:30:03,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44c7a4b3-a213-4727-86f5-2f7de4d1ab1e] received 2024-02-23T03:30:03.994851700Z [2024-02-23 03:30:03,994: INFO/ForkPoolWorker-16] [44c7a4b3-a213-4727-86f5-2f7de4d1ab1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:30:04.072239949Z [2024-02-23 03:30:04,071: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f9a9406-c314-45ed-9644-9d7a7d166e71] succeeded in 2.9596841170005064s: None 2024-02-23T03:30:04.317891251Z [2024-02-23 03:30:04,314: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:30:05.113368677Z [2024-02-23 03:30:05,112: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7418d30a-90ff-4f49-a2d1-dbc37fc6cc49] succeeded in 3.9666714610011695s: None 2024-02-23T03:30:05.277738500Z [2024-02-23 03:30:05,277: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7044b4f7-4251-4b3a-98c6-9f4ac14aafb5] succeeded in 4.135262796000461s: None 2024-02-23T03:30:05.554115712Z [2024-02-23 03:30:05,553: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:30:05.557584718Z [2024-02-23 03:30:05,556: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:05.583465877Z [2024-02-23 03:30:05,583: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:30:05.585600781Z [2024-02-23 03:30:05,585: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:30:05.585945958Z [2024-02-23 03:30:05,585: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:30:05.586534691Z [2024-02-23 03:30:05,585: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:30:05.586798050Z [2024-02-23 03:30:05,586: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:30:05.587331259Z [2024-02-23 03:30:05,587: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:30:05.587542084Z [2024-02-23 03:30:05,587: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:30:05.666281639Z [2024-02-23 03:30:05,665: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:06.347482322Z [2024-02-23 03:30:06,346: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44c7a4b3-a213-4727-86f5-2f7de4d1ab1e] succeeded in 2.358092652000778s: None 2024-02-23T03:30:07.007860921Z [2024-02-23 03:30:07,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bd82dd9-5878-4bf2-8fb1-55b688824462] received 2024-02-23T03:30:07.014413345Z [2024-02-23 03:30:07,014: INFO/ForkPoolWorker-15] [3bd82dd9-5878-4bf2-8fb1-55b688824462] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:30:07.328722508Z [2024-02-23 03:30:07,325: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:30:08.630893252Z [2024-02-23 03:30:08,630: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:30:08.634057486Z [2024-02-23 03:30:08,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:08.656311008Z [2024-02-23 03:30:08,656: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:30:08.657927207Z [2024-02-23 03:30:08,657: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:30:08.657979663Z [2024-02-23 03:30:08,657: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:30:08.658153318Z [2024-02-23 03:30:08,657: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:30:08.658187495Z [2024-02-23 03:30:08,658: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:30:08.658569386Z [2024-02-23 03:30:08,658: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:30:08.658626083Z [2024-02-23 03:30:08,658: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:30:08.754818761Z [2024-02-23 03:30:08,754: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:09.440238350Z [2024-02-23 03:30:09,439: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3bd82dd9-5878-4bf2-8fb1-55b688824462] succeeded in 2.4307363190000615s: None 2024-02-23T03:30:09.898382951Z [2024-02-23 03:30:09,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[034caacb-2504-4a8a-ad3e-31435fc6267f] received 2024-02-23T03:30:09.917575253Z [2024-02-23 03:30:09,915: INFO/ForkPoolWorker-15] [034caacb-2504-4a8a-ad3e-31435fc6267f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:30:10.293900310Z [2024-02-23 03:30:10,290: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:30:11.682035155Z [2024-02-23 03:30:11,681: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:30:11.685662169Z [2024-02-23 03:30:11,685: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:30:11.722786951Z [2024-02-23 03:30:11,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:30:11.724653211Z [2024-02-23 03:30:11,724: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:30:11.724690688Z [2024-02-23 03:30:11,724: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:30:11.724831176Z [2024-02-23 03:30:11,724: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:30:11.724929696Z [2024-02-23 03:30:11,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:30:11.725337050Z [2024-02-23 03:30:11,725: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:30:11.725419908Z [2024-02-23 03:30:11,725: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:30:11.860899239Z [2024-02-23 03:30:11,860: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:30:12.524116494Z [2024-02-23 03:30:12,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[034caacb-2504-4a8a-ad3e-31435fc6267f] succeeded in 2.624411222999697s: None 2024-02-23T03:31:00.582877423Z [2024-02-23 03:31:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93a00b60-07fe-402d-ab87-2a804d417f24] received 2024-02-23T03:31:00.585497049Z [2024-02-23 03:31:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec47f175-e542-4daa-bc27-df31b3b0d582] received 2024-02-23T03:31:00.591997953Z [2024-02-23 03:31:00,591: INFO/ForkPoolWorker-15] [93a00b60-07fe-402d-ab87-2a804d417f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:31:00.593889713Z [2024-02-23 03:31:00,593: INFO/ForkPoolWorker-16] [ec47f175-e542-4daa-bc27-df31b3b0d582] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:31:00.599925620Z [2024-02-23 03:31:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[044745db-8df6-48ed-87cb-c0f9a49c1f73] received 2024-02-23T03:31:00.606794715Z [2024-02-23 03:31:00,606: INFO/ForkPoolWorker-1] [044745db-8df6-48ed-87cb-c0f9a49c1f73] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:31:00.880218293Z [2024-02-23 03:31:00,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:31:00.978979385Z [2024-02-23 03:31:00,975: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:31:00.992465364Z [2024-02-23 03:31:00,989: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:31:01.143583240Z [2024-02-23 03:31:01,143: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:31:01.148421113Z [2024-02-23 03:31:01,147: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:31:01.176150715Z [2024-02-23 03:31:01,175: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:31:01.179752646Z [2024-02-23 03:31:01,179: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:31:01.179805452Z [2024-02-23 03:31:01,179: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:31:01.179880373Z [2024-02-23 03:31:01,179: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:31:01.180205204Z [2024-02-23 03:31:01,180: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:31:01.290327591Z [2024-02-23 03:31:01,290: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:31:02.069973653Z [2024-02-23 03:31:02,069: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[044745db-8df6-48ed-87cb-c0f9a49c1f73] succeeded in 1.4681887099995947s: None 2024-02-23T03:31:02.212437339Z [2024-02-23 03:31:02,212: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:31:02.215741876Z [2024-02-23 03:31:02,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:31:02.239746994Z [2024-02-23 03:31:02,239: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:31:02.241975751Z [2024-02-23 03:31:02,241: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:31:02.242013051Z [2024-02-23 03:31:02,241: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:31:02.242253983Z [2024-02-23 03:31:02,241: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:31:02.242413153Z [2024-02-23 03:31:02,242: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:31:02.243091362Z [2024-02-23 03:31:02,242: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:31:02.243410653Z [2024-02-23 03:31:02,243: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:31:02.277829895Z [2024-02-23 03:31:02,277: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:31:02.281231845Z [2024-02-23 03:31:02,280: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:31:02.308672004Z [2024-02-23 03:31:02,308: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:31:02.309992532Z [2024-02-23 03:31:02,309: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:31:02.310177411Z [2024-02-23 03:31:02,310: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:31:02.310384852Z [2024-02-23 03:31:02,310: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:31:02.310523264Z [2024-02-23 03:31:02,310: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:31:02.311140759Z [2024-02-23 03:31:02,310: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:31:02.311319948Z [2024-02-23 03:31:02,311: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:31:02.337790590Z [2024-02-23 03:31:02,337: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:31:02.428758863Z [2024-02-23 03:31:02,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:31:04.253041264Z [2024-02-23 03:31:04,252: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec47f175-e542-4daa-bc27-df31b3b0d582] succeeded in 3.665570225999545s: None 2024-02-23T03:31:04.498872868Z [2024-02-23 03:31:04,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93a00b60-07fe-402d-ab87-2a804d417f24] succeeded in 3.9145462270007556s: None 2024-02-23T03:32:01.077233461Z [2024-02-23 03:32:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[391c6cbd-c4d6-4336-a4e5-5962e041512d] received 2024-02-23T03:32:01.085666294Z [2024-02-23 03:32:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7006401-b6c9-498f-a88f-afe348f4d1fe] received 2024-02-23T03:32:01.088657473Z [2024-02-23 03:32:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af0a8022-b7d3-4a7d-95df-9ca461258a21] received 2024-02-23T03:32:01.094344187Z [2024-02-23 03:32:01,093: INFO/ForkPoolWorker-15] [391c6cbd-c4d6-4336-a4e5-5962e041512d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:32:01.095799236Z [2024-02-23 03:32:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05a6aa6b-2cd8-4edf-89a1-dad90aa5a32a] received 2024-02-23T03:32:01.114747174Z [2024-02-23 03:32:01,112: INFO/ForkPoolWorker-1] [af0a8022-b7d3-4a7d-95df-9ca461258a21] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:32:01.117017385Z [2024-02-23 03:32:01,116: INFO/ForkPoolWorker-2] [05a6aa6b-2cd8-4edf-89a1-dad90aa5a32a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:32:01.117493324Z [2024-02-23 03:32:01,117: INFO/ForkPoolWorker-16] [f7006401-b6c9-498f-a88f-afe348f4d1fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:32:01.413528571Z [2024-02-23 03:32:01,410: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:32:01.444672010Z [2024-02-23 03:32:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:32:01.499643732Z [2024-02-23 03:32:01,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:32:01.561601071Z [2024-02-23 03:32:01,557: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:32:01.729973158Z [2024-02-23 03:32:01,729: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:32:01.733807640Z [2024-02-23 03:32:01,733: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:32:01.737953254Z [2024-02-23 03:32:01,737: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:32:01.764364547Z [2024-02-23 03:32:01,764: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:32:01.766148734Z [2024-02-23 03:32:01,765: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:32:01.766424627Z [2024-02-23 03:32:01,766: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:32:01.766646610Z [2024-02-23 03:32:01,766: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:32:01.766988687Z [2024-02-23 03:32:01,766: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:32:01.863370284Z [2024-02-23 03:32:01,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:32:02.382994062Z [2024-02-23 03:32:02,382: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af0a8022-b7d3-4a7d-95df-9ca461258a21] succeeded in 1.2855387039999187s: None 2024-02-23T03:32:02.608393332Z [2024-02-23 03:32:02,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7006401-b6c9-498f-a88f-afe348f4d1fe] succeeded in 1.5080490290001762s: None 2024-02-23T03:32:02.768143446Z [2024-02-23 03:32:02,767: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:32:02.771601591Z [2024-02-23 03:32:02,771: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:32:02.813340629Z [2024-02-23 03:32:02,813: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:32:02.814867442Z [2024-02-23 03:32:02,814: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:32:02.814941932Z [2024-02-23 03:32:02,814: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:32:02.815108662Z [2024-02-23 03:32:02,814: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:32:02.815193708Z [2024-02-23 03:32:02,815: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:32:02.815487674Z [2024-02-23 03:32:02,815: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:32:02.815519965Z [2024-02-23 03:32:02,815: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:32:02.923638857Z [2024-02-23 03:32:02,923: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:32:03.077489547Z [2024-02-23 03:32:03,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:32:03.081280117Z [2024-02-23 03:32:03,080: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:32:03.107856093Z [2024-02-23 03:32:03,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:32:03.110057098Z [2024-02-23 03:32:03,109: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:32:03.110876799Z [2024-02-23 03:32:03,110: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:32:03.111196594Z [2024-02-23 03:32:03,110: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:32:03.111372726Z [2024-02-23 03:32:03,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:32:03.112418528Z [2024-02-23 03:32:03,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:32:03.112439067Z [2024-02-23 03:32:03,112: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:32:03.219275555Z [2024-02-23 03:32:03,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:32:04.643134332Z [2024-02-23 03:32:04,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[391c6cbd-c4d6-4336-a4e5-5962e041512d] succeeded in 3.5628334709999763s: None 2024-02-23T03:32:04.729246891Z [2024-02-23 03:32:04,724: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05a6aa6b-2cd8-4edf-89a1-dad90aa5a32a] succeeded in 3.627317812999536s: None 2024-02-23T03:33:00.851124006Z [2024-02-23 03:33:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e04bf55a-863b-4208-922f-01962f3ca150] received 2024-02-23T03:33:00.852298872Z [2024-02-23 03:33:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[558b3d30-3738-4e4f-b64d-f0a82fbdc081] received 2024-02-23T03:33:00.857916422Z [2024-02-23 03:33:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[840c8c15-3ba9-4704-a4b5-4c9f45fb7275] received 2024-02-23T03:33:00.859892021Z [2024-02-23 03:33:00,859: INFO/ForkPoolWorker-15] [e04bf55a-863b-4208-922f-01962f3ca150] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:33:00.862438184Z [2024-02-23 03:33:00,862: INFO/ForkPoolWorker-16] [558b3d30-3738-4e4f-b64d-f0a82fbdc081] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:33:00.876979015Z [2024-02-23 03:33:00,876: INFO/ForkPoolWorker-1] [840c8c15-3ba9-4704-a4b5-4c9f45fb7275] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:33:01.184835508Z [2024-02-23 03:33:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:33:01.212590028Z [2024-02-23 03:33:01,208: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:33:01.225869902Z [2024-02-23 03:33:01,222: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:33:01.398687750Z [2024-02-23 03:33:01,398: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:33:01.403787172Z [2024-02-23 03:33:01,403: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:33:01.428406095Z [2024-02-23 03:33:01,428: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:33:01.430110510Z [2024-02-23 03:33:01,429: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:33:01.430286889Z [2024-02-23 03:33:01,430: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:33:01.430431402Z [2024-02-23 03:33:01,430: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:33:01.430876222Z [2024-02-23 03:33:01,430: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:33:01.564877087Z [2024-02-23 03:33:01,564: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:33:02.219555443Z [2024-02-23 03:33:02,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[840c8c15-3ba9-4704-a4b5-4c9f45fb7275] succeeded in 1.3588338919998932s: None 2024-02-23T03:33:02.478236655Z [2024-02-23 03:33:02,477: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:33:02.481661860Z [2024-02-23 03:33:02,481: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:33:02.507744171Z [2024-02-23 03:33:02,507: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:33:02.509385297Z [2024-02-23 03:33:02,509: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:33:02.509401174Z [2024-02-23 03:33:02,509: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:33:02.509619158Z [2024-02-23 03:33:02,509: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:33:02.509649663Z [2024-02-23 03:33:02,509: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:33:02.509935922Z [2024-02-23 03:33:02,509: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:33:02.509976391Z [2024-02-23 03:33:02,509: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:33:02.537489185Z [2024-02-23 03:33:02,537: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:33:02.540797637Z [2024-02-23 03:33:02,540: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:33:02.579990024Z [2024-02-23 03:33:02,579: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:33:02.581945405Z [2024-02-23 03:33:02,581: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:33:02.582070469Z [2024-02-23 03:33:02,581: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:33:02.582313174Z [2024-02-23 03:33:02,582: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:33:02.582567037Z [2024-02-23 03:33:02,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:33:02.583427920Z [2024-02-23 03:33:02,582: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:33:02.583678815Z [2024-02-23 03:33:02,583: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:33:02.611770822Z [2024-02-23 03:33:02,611: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:33:02.690968781Z [2024-02-23 03:33:02,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:33:04.923011084Z [2024-02-23 03:33:04,922: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[558b3d30-3738-4e4f-b64d-f0a82fbdc081] succeeded in 4.069408280998687s: None 2024-02-23T03:33:06.152367056Z [2024-02-23 03:33:06,151: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e04bf55a-863b-4208-922f-01962f3ca150] succeeded in 5.298856023000553s: None 2024-02-23T03:34:00.981371913Z [2024-02-23 03:34:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[860f001f-6cd7-4f86-b37f-0dceb2de4e4a] received 2024-02-23T03:34:00.983230175Z [2024-02-23 03:34:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5766583b-576b-483b-b0eb-85ed7aabe0fe] received 2024-02-23T03:34:00.989476117Z [2024-02-23 03:34:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c20669c6-98de-49a7-a194-75630a13c878] received 2024-02-23T03:34:00.991690857Z [2024-02-23 03:34:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cfb0ea4-4b4e-417b-93e2-1d150b4d998f] received 2024-02-23T03:34:00.999214204Z [2024-02-23 03:34:00,998: INFO/ForkPoolWorker-16] [5766583b-576b-483b-b0eb-85ed7aabe0fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:34:01.001069966Z [2024-02-23 03:34:01,000: INFO/ForkPoolWorker-15] [860f001f-6cd7-4f86-b37f-0dceb2de4e4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:34:01.004217672Z [2024-02-23 03:34:01,003: INFO/ForkPoolWorker-1] [c20669c6-98de-49a7-a194-75630a13c878] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:34:01.022051584Z [2024-02-23 03:34:01,021: INFO/ForkPoolWorker-2] [7cfb0ea4-4b4e-417b-93e2-1d150b4d998f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:34:01.330958554Z [2024-02-23 03:34:01,327: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:34:01.360334499Z [2024-02-23 03:34:01,356: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:34:01.381745352Z [2024-02-23 03:34:01,376: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:34:01.410317216Z [2024-02-23 03:34:01,407: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:34:01.538010778Z [2024-02-23 03:34:01,537: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:34:01.542895129Z [2024-02-23 03:34:01,542: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:34:01.577524540Z [2024-02-23 03:34:01,577: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:34:01.579436297Z [2024-02-23 03:34:01,579: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:34:01.579669521Z [2024-02-23 03:34:01,579: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:34:01.579831860Z [2024-02-23 03:34:01,579: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:34:01.580315696Z [2024-02-23 03:34:01,580: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:34:01.762145333Z [2024-02-23 03:34:01,761: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:34:01.791439500Z [2024-02-23 03:34:01,791: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:34:02.472725082Z [2024-02-23 03:34:02,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[860f001f-6cd7-4f86-b37f-0dceb2de4e4a] succeeded in 1.4865037309991749s: None 2024-02-23T03:34:02.537093252Z [2024-02-23 03:34:02,536: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7cfb0ea4-4b4e-417b-93e2-1d150b4d998f] succeeded in 1.537958480999805s: None 2024-02-23T03:34:02.878057517Z [2024-02-23 03:34:02,877: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:34:02.881548061Z [2024-02-23 03:34:02,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:34:02.906737852Z [2024-02-23 03:34:02,906: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:34:02.908839001Z [2024-02-23 03:34:02,908: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:34:02.909115295Z [2024-02-23 03:34:02,908: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:34:02.909407078Z [2024-02-23 03:34:02,909: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:34:02.909645309Z [2024-02-23 03:34:02,909: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:34:02.910176531Z [2024-02-23 03:34:02,909: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:34:02.910420864Z [2024-02-23 03:34:02,910: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:34:02.981524790Z [2024-02-23 03:34:02,981: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:34:02.985011213Z [2024-02-23 03:34:02,984: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:34:02.993537916Z [2024-02-23 03:34:02,993: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:34:03.012219954Z [2024-02-23 03:34:03,011: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:34:03.013657239Z [2024-02-23 03:34:03,013: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:34:03.013681155Z [2024-02-23 03:34:03,013: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:34:03.013845573Z [2024-02-23 03:34:03,013: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:34:03.013884602Z [2024-02-23 03:34:03,013: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:34:03.014149159Z [2024-02-23 03:34:03,013: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:34:03.014166026Z [2024-02-23 03:34:03,014: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:34:03.103401151Z [2024-02-23 03:34:03,103: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:34:04.590813069Z [2024-02-23 03:34:04,590: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c20669c6-98de-49a7-a194-75630a13c878] succeeded in 3.597476529999767s: None 2024-02-23T03:34:05.366983139Z [2024-02-23 03:34:05,360: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5766583b-576b-483b-b0eb-85ed7aabe0fe] succeeded in 4.375028227999792s: None 2024-02-23T03:35:00.966573583Z [2024-02-23 03:35:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3a167fb-bca4-48ee-9c02-41c038fe456b] received 2024-02-23T03:35:00.973057786Z [2024-02-23 03:35:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3369305c-2f72-461e-a67d-14ae77f94bf7] received 2024-02-23T03:35:00.977243841Z [2024-02-23 03:35:00,976: INFO/ForkPoolWorker-15] [c3a167fb-bca4-48ee-9c02-41c038fe456b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:35:00.986730185Z [2024-02-23 03:35:00,986: INFO/ForkPoolWorker-16] [3369305c-2f72-461e-a67d-14ae77f94bf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:35:00.992360993Z [2024-02-23 03:35:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c8d65b8-ceda-434b-9a8c-87e3353e9697] received 2024-02-23T03:35:00.998673228Z [2024-02-23 03:35:00,998: INFO/ForkPoolWorker-1] [7c8d65b8-ceda-434b-9a8c-87e3353e9697] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:35:00.999556212Z [2024-02-23 03:35:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00a938b3-206d-4001-b286-968f4967a7f0] received 2024-02-23T03:35:01.014724485Z [2024-02-23 03:35:01,014: INFO/ForkPoolWorker-2] [00a938b3-206d-4001-b286-968f4967a7f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:35:01.329148895Z [2024-02-23 03:35:01,325: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:35:01.340850534Z [2024-02-23 03:35:01,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:35:01.392489017Z [2024-02-23 03:35:01,388: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:35:01.430805407Z [2024-02-23 03:35:01,426: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:35:01.530453832Z [2024-02-23 03:35:01,529: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:35:01.535394585Z [2024-02-23 03:35:01,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:01.566917003Z [2024-02-23 03:35:01,566: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:35:01.572033461Z [2024-02-23 03:35:01,571: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:35:01.572694660Z [2024-02-23 03:35:01,571: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:35:01.572872576Z [2024-02-23 03:35:01,572: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:35:01.573970692Z [2024-02-23 03:35:01,573: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:35:01.719278266Z [2024-02-23 03:35:01,718: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:02.413077465Z [2024-02-23 03:35:02,412: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[00a938b3-206d-4001-b286-968f4967a7f0] succeeded in 1.4036840570006461s: None 2024-02-23T03:35:02.710062387Z [2024-02-23 03:35:02,709: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:35:02.714531179Z [2024-02-23 03:35:02,713: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:02.724340854Z [2024-02-23 03:35:02,723: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:35:02.727601618Z [2024-02-23 03:35:02,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:02.736683523Z [2024-02-23 03:35:02,736: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:35:02.738711406Z [2024-02-23 03:35:02,738: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:35:02.738869854Z [2024-02-23 03:35:02,738: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:35:02.739129180Z [2024-02-23 03:35:02,738: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:35:02.739230294Z [2024-02-23 03:35:02,739: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:35:02.739595868Z [2024-02-23 03:35:02,739: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:35:02.739768821Z [2024-02-23 03:35:02,739: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:35:02.755465673Z [2024-02-23 03:35:02,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:35:02.756870238Z [2024-02-23 03:35:02,756: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:35:02.756885576Z [2024-02-23 03:35:02,756: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:35:02.757000594Z [2024-02-23 03:35:02,756: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:35:02.757011231Z [2024-02-23 03:35:02,756: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:35:02.757252744Z [2024-02-23 03:35:02,757: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:35:02.757290553Z [2024-02-23 03:35:02,757: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:35:02.851604609Z [2024-02-23 03:35:02,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:02.866965061Z [2024-02-23 03:35:02,866: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:03.149334282Z [2024-02-23 03:35:03,148: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:35:03.153323654Z [2024-02-23 03:35:03,152: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:03.183686997Z [2024-02-23 03:35:03,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:35:03.185614747Z [2024-02-23 03:35:03,185: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:35:03.185633608Z [2024-02-23 03:35:03,185: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:35:03.185898551Z [2024-02-23 03:35:03,185: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:35:03.186022107Z [2024-02-23 03:35:03,185: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:35:03.186588260Z [2024-02-23 03:35:03,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:35:03.186597597Z [2024-02-23 03:35:03,186: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:35:03.289145618Z [2024-02-23 03:35:03,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:04.030709737Z [2024-02-23 03:35:04,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3a167fb-bca4-48ee-9c02-41c038fe456b] succeeded in 3.0616088019996823s: None 2024-02-23T03:35:04.328089451Z [2024-02-23 03:35:04,327: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c8d65b8-ceda-434b-9a8c-87e3353e9697] succeeded in 3.3336176329994487s: None 2024-02-23T03:35:04.824698536Z [2024-02-23 03:35:04,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[757b918a-4d72-4282-a8cc-004d0ee9fc66] received 2024-02-23T03:35:04.832008406Z [2024-02-23 03:35:04,831: INFO/ForkPoolWorker-15] [757b918a-4d72-4282-a8cc-004d0ee9fc66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:35:05.162541895Z [2024-02-23 03:35:05,159: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:35:05.508129274Z [2024-02-23 03:35:05,507: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3369305c-2f72-461e-a67d-14ae77f94bf7] succeeded in 4.530643587000668s: None 2024-02-23T03:35:06.478461390Z [2024-02-23 03:35:06,477: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:35:06.481705456Z [2024-02-23 03:35:06,481: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:06.511016964Z [2024-02-23 03:35:06,510: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:35:06.513469832Z [2024-02-23 03:35:06,513: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:35:06.513583613Z [2024-02-23 03:35:06,513: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:35:06.513841136Z [2024-02-23 03:35:06,513: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:35:06.513965016Z [2024-02-23 03:35:06,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:35:06.514542785Z [2024-02-23 03:35:06,514: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:35:06.514640666Z [2024-02-23 03:35:06,514: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:35:06.625471361Z [2024-02-23 03:35:06,625: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:07.296369456Z [2024-02-23 03:35:07,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[757b918a-4d72-4282-a8cc-004d0ee9fc66] succeeded in 2.469189675000962s: None 2024-02-23T03:35:08.149250447Z [2024-02-23 03:35:08,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afa2adc4-17dc-474b-b109-7fb00d9328f1] received 2024-02-23T03:35:08.159866537Z [2024-02-23 03:35:08,159: INFO/ForkPoolWorker-15] [afa2adc4-17dc-474b-b109-7fb00d9328f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:35:08.419584691Z [2024-02-23 03:35:08,416: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:35:09.502769813Z [2024-02-23 03:35:09,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:35:09.506094820Z [2024-02-23 03:35:09,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:09.528816969Z [2024-02-23 03:35:09,528: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:35:09.530431561Z [2024-02-23 03:35:09,530: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:35:09.530566410Z [2024-02-23 03:35:09,530: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:35:09.530741478Z [2024-02-23 03:35:09,530: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:35:09.530803586Z [2024-02-23 03:35:09,530: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:35:09.531311071Z [2024-02-23 03:35:09,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:35:09.531319987Z [2024-02-23 03:35:09,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:35:09.626773495Z [2024-02-23 03:35:09,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:11.201864351Z [2024-02-23 03:35:11,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afa2adc4-17dc-474b-b109-7fb00d9328f1] succeeded in 3.0497158849993866s: None 2024-02-23T03:35:11.292407957Z [2024-02-23 03:35:11,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc171ce1-5b2b-4e1c-a1c5-4649bf6306e9] received 2024-02-23T03:35:11.299349821Z [2024-02-23 03:35:11,299: INFO/ForkPoolWorker-15] [cc171ce1-5b2b-4e1c-a1c5-4649bf6306e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:35:11.588612007Z [2024-02-23 03:35:11,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:35:12.683949093Z [2024-02-23 03:35:12,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:35:12.687206992Z [2024-02-23 03:35:12,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:35:12.709651119Z [2024-02-23 03:35:12,709: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:35:12.711178597Z [2024-02-23 03:35:12,710: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:35:12.711303584Z [2024-02-23 03:35:12,711: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:35:12.711510373Z [2024-02-23 03:35:12,711: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:35:12.711593743Z [2024-02-23 03:35:12,711: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:35:12.711925184Z [2024-02-23 03:35:12,711: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:35:12.712017367Z [2024-02-23 03:35:12,711: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:35:12.831325526Z [2024-02-23 03:35:12,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:35:13.442649840Z [2024-02-23 03:35:13,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc171ce1-5b2b-4e1c-a1c5-4649bf6306e9] succeeded in 2.148067259000527s: None 2024-02-23T03:36:00.923439488Z [2024-02-23 03:36:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34374e49-b42a-4f0f-b487-9559ffe9d1dc] received 2024-02-23T03:36:00.926353556Z [2024-02-23 03:36:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a16aefa-3121-490b-86e4-3b0b73a93694] received 2024-02-23T03:36:00.928677334Z [2024-02-23 03:36:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e54c33ae-598a-451b-874c-a8e4c27e2651] received 2024-02-23T03:36:00.930037252Z [2024-02-23 03:36:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45582764-e4d3-4106-8bfe-b33a0254e2aa] received 2024-02-23T03:36:00.935776566Z [2024-02-23 03:36:00,935: INFO/ForkPoolWorker-1] [e54c33ae-598a-451b-874c-a8e4c27e2651] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:36:00.940001911Z [2024-02-23 03:36:00,939: INFO/ForkPoolWorker-15] [34374e49-b42a-4f0f-b487-9559ffe9d1dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:36:00.942522687Z [2024-02-23 03:36:00,941: INFO/ForkPoolWorker-16] [7a16aefa-3121-490b-86e4-3b0b73a93694] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:36:00.945080374Z [2024-02-23 03:36:00,944: INFO/ForkPoolWorker-2] [45582764-e4d3-4106-8bfe-b33a0254e2aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:36:01.232485115Z [2024-02-23 03:36:01,229: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:36:01.253587372Z [2024-02-23 03:36:01,250: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:36:01.297131751Z [2024-02-23 03:36:01,293: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:36:01.334597692Z [2024-02-23 03:36:01,331: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:36:01.392249971Z [2024-02-23 03:36:01,391: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:36:01.396171061Z [2024-02-23 03:36:01,395: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:36:01.433384297Z [2024-02-23 03:36:01,433: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:36:01.438763465Z [2024-02-23 03:36:01,438: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:36:01.439122269Z [2024-02-23 03:36:01,438: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:36:01.439318376Z [2024-02-23 03:36:01,439: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:36:01.439635303Z [2024-02-23 03:36:01,439: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:36:01.582484166Z [2024-02-23 03:36:01,582: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:36:01.584078461Z [2024-02-23 03:36:01,583: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:36:02.240134476Z [2024-02-23 03:36:02,239: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e54c33ae-598a-451b-874c-a8e4c27e2651] succeeded in 1.3104010259994539s: None 2024-02-23T03:36:02.299772156Z [2024-02-23 03:36:02,299: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a16aefa-3121-490b-86e4-3b0b73a93694] succeeded in 1.3717931890005275s: None 2024-02-23T03:36:02.591208036Z [2024-02-23 03:36:02,590: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:36:02.594547195Z [2024-02-23 03:36:02,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:36:02.627451952Z [2024-02-23 03:36:02,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:36:02.633575157Z [2024-02-23 03:36:02,633: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:36:02.633613132Z [2024-02-23 03:36:02,633: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:36:02.635270920Z [2024-02-23 03:36:02,633: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:36:02.635625553Z [2024-02-23 03:36:02,635: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:36:02.636695050Z [2024-02-23 03:36:02,636: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:36:02.637245022Z [2024-02-23 03:36:02,636: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:36:02.753650494Z [2024-02-23 03:36:02,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:36:02.832874185Z [2024-02-23 03:36:02,832: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:36:02.836078407Z [2024-02-23 03:36:02,835: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:36:02.869133649Z [2024-02-23 03:36:02,868: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:36:02.871174208Z [2024-02-23 03:36:02,870: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:36:02.871225689Z [2024-02-23 03:36:02,871: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:36:02.871439774Z [2024-02-23 03:36:02,871: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:36:02.871482166Z [2024-02-23 03:36:02,871: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:36:02.871864791Z [2024-02-23 03:36:02,871: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:36:02.871939908Z [2024-02-23 03:36:02,871: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:36:02.964066275Z [2024-02-23 03:36:02,963: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:36:05.540806021Z [2024-02-23 03:36:05,540: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34374e49-b42a-4f0f-b487-9559ffe9d1dc] succeeded in 4.616132698000001s: None 2024-02-23T03:36:07.473893371Z [2024-02-23 03:36:07,473: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[45582764-e4d3-4106-8bfe-b33a0254e2aa] succeeded in 6.541524286998538s: None 2024-02-23T03:37:00.262569449Z [2024-02-23 03:37:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31e17fcf-e1d8-4932-9e53-9b73ab5b020b] received 2024-02-23T03:37:00.270688218Z [2024-02-23 03:37:00,270: INFO/ForkPoolWorker-15] [31e17fcf-e1d8-4932-9e53-9b73ab5b020b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:37:00.276040919Z [2024-02-23 03:37:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0cd4c28-715a-46db-8db9-c8065a399333] received 2024-02-23T03:37:00.277542203Z [2024-02-23 03:37:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0c58cc3-bd50-4ac1-8437-963eb7e14c55] received 2024-02-23T03:37:00.284731689Z [2024-02-23 03:37:00,284: INFO/ForkPoolWorker-1] [b0c58cc3-bd50-4ac1-8437-963eb7e14c55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:37:00.285303883Z [2024-02-23 03:37:00,285: INFO/ForkPoolWorker-16] [e0cd4c28-715a-46db-8db9-c8065a399333] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:37:00.569075512Z [2024-02-23 03:37:00,566: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:37:00.615869418Z [2024-02-23 03:37:00,612: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:37:00.655074269Z [2024-02-23 03:37:00,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:37:00.787772630Z [2024-02-23 03:37:00,787: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:37:00.791707987Z [2024-02-23 03:37:00,791: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:37:00.816613143Z [2024-02-23 03:37:00,816: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:37:00.817675948Z [2024-02-23 03:37:00,817: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:37:00.817743787Z [2024-02-23 03:37:00,817: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:37:00.817820156Z [2024-02-23 03:37:00,817: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:37:00.817993275Z [2024-02-23 03:37:00,817: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:37:00.901727926Z [2024-02-23 03:37:00,901: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:37:01.507571154Z [2024-02-23 03:37:01,507: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0cd4c28-715a-46db-8db9-c8065a399333] succeeded in 1.2275523409989546s: None 2024-02-23T03:37:01.723188805Z [2024-02-23 03:37:01,722: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:37:01.726308150Z [2024-02-23 03:37:01,725: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:37:01.764277363Z [2024-02-23 03:37:01,764: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:37:01.766486783Z [2024-02-23 03:37:01,766: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:37:01.766533013Z [2024-02-23 03:37:01,766: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:37:01.766675869Z [2024-02-23 03:37:01,766: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:37:01.766699687Z [2024-02-23 03:37:01,766: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:37:01.766974978Z [2024-02-23 03:37:01,766: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:37:01.767002955Z [2024-02-23 03:37:01,766: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:37:01.877210970Z [2024-02-23 03:37:01,876: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:37:01.946939964Z [2024-02-23 03:37:01,946: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:37:01.950326381Z [2024-02-23 03:37:01,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:37:01.969270955Z [2024-02-23 03:37:01,969: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:37:01.970467368Z [2024-02-23 03:37:01,970: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:37:01.970484990Z [2024-02-23 03:37:01,970: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:37:01.970661254Z [2024-02-23 03:37:01,970: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:37:01.970716350Z [2024-02-23 03:37:01,970: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:37:01.971272604Z [2024-02-23 03:37:01,970: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:37:01.971283070Z [2024-02-23 03:37:01,971: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:37:02.070585817Z [2024-02-23 03:37:02,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:37:03.449297637Z [2024-02-23 03:37:03,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0c58cc3-bd50-4ac1-8437-963eb7e14c55] succeeded in 3.1697399630011205s: None 2024-02-23T03:37:04.113324976Z [2024-02-23 03:37:04,112: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31e17fcf-e1d8-4932-9e53-9b73ab5b020b] succeeded in 3.8475303830000485s: None 2024-02-23T03:38:00.758917876Z [2024-02-23 03:38:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bcc7a2d-aa6b-4583-aa61-c2a1c0a1b79a] received 2024-02-23T03:38:00.764627619Z [2024-02-23 03:38:00,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbdbd0da-7f3b-419d-a0b6-14d176cdffb6] received 2024-02-23T03:38:00.768001041Z [2024-02-23 03:38:00,767: INFO/ForkPoolWorker-15] [2bcc7a2d-aa6b-4583-aa61-c2a1c0a1b79a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:38:00.773019334Z [2024-02-23 03:38:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b56697fe-207b-45b5-af87-88dd2dedafb0] received 2024-02-23T03:38:00.779831740Z [2024-02-23 03:38:00,779: INFO/ForkPoolWorker-16] [dbdbd0da-7f3b-419d-a0b6-14d176cdffb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:38:00.787612781Z [2024-02-23 03:38:00,787: INFO/ForkPoolWorker-1] [b56697fe-207b-45b5-af87-88dd2dedafb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:38:00.799737969Z [2024-02-23 03:38:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27678b4f-7862-49a2-9a01-896ae58170d5] received 2024-02-23T03:38:00.813430835Z [2024-02-23 03:38:00,812: INFO/ForkPoolWorker-2] [27678b4f-7862-49a2-9a01-896ae58170d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:38:01.099802508Z [2024-02-23 03:38:01,096: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:38:01.184613357Z [2024-02-23 03:38:01,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:38:01.339366589Z [2024-02-23 03:38:01,325: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:38:01.490034085Z [2024-02-23 03:38:01,489: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:38:01.521686618Z [2024-02-23 03:38:01,517: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:38:01.730036315Z [2024-02-23 03:38:01,729: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:38:01.734727810Z [2024-02-23 03:38:01,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:38:01.779675876Z [2024-02-23 03:38:01,779: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:38:01.781126799Z [2024-02-23 03:38:01,780: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:38:01.781170641Z [2024-02-23 03:38:01,781: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:38:01.781237173Z [2024-02-23 03:38:01,781: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:38:01.781432818Z [2024-02-23 03:38:01,781: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:38:01.914089930Z [2024-02-23 03:38:01,913: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:38:02.220710055Z [2024-02-23 03:38:02,220: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2bcc7a2d-aa6b-4583-aa61-c2a1c0a1b79a] succeeded in 1.4603134150002006s: None 2024-02-23T03:38:02.563886571Z [2024-02-23 03:38:02,563: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[27678b4f-7862-49a2-9a01-896ae58170d5] succeeded in 1.7622485049996612s: None 2024-02-23T03:38:02.598208575Z [2024-02-23 03:38:02,597: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:38:02.601540991Z [2024-02-23 03:38:02,601: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:38:02.625953319Z [2024-02-23 03:38:02,625: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:38:02.627652922Z [2024-02-23 03:38:02,627: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:38:02.627788367Z [2024-02-23 03:38:02,627: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:38:02.627970718Z [2024-02-23 03:38:02,627: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:38:02.628074061Z [2024-02-23 03:38:02,627: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:38:02.628394500Z [2024-02-23 03:38:02,628: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:38:02.628514877Z [2024-02-23 03:38:02,628: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:38:02.709971915Z [2024-02-23 03:38:02,709: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:38:02.785659461Z [2024-02-23 03:38:02,785: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:38:02.789076446Z [2024-02-23 03:38:02,788: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:38:02.816902727Z [2024-02-23 03:38:02,816: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:38:02.840653957Z [2024-02-23 03:38:02,840: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:38:02.840671852Z [2024-02-23 03:38:02,840: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:38:02.840696314Z [2024-02-23 03:38:02,840: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:38:02.840772395Z [2024-02-23 03:38:02,840: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:38:02.841040807Z [2024-02-23 03:38:02,840: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:38:02.841074402Z [2024-02-23 03:38:02,840: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:38:02.972229809Z [2024-02-23 03:38:02,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:38:04.526179991Z [2024-02-23 03:38:04,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b56697fe-207b-45b5-af87-88dd2dedafb0] succeeded in 3.749377784000899s: None 2024-02-23T03:38:04.669503174Z [2024-02-23 03:38:04,669: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbdbd0da-7f3b-419d-a0b6-14d176cdffb6] succeeded in 3.901736408999568s: None 2024-02-23T03:39:01.150422094Z [2024-02-23 03:39:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a6e72cb-9970-42f2-8eb8-419293473332] received 2024-02-23T03:39:01.153935244Z [2024-02-23 03:39:01,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a938519-e080-47ad-9c4b-ae266aeeb367] received 2024-02-23T03:39:01.157564778Z [2024-02-23 03:39:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d7634f4-a74a-41bb-9d8a-aa6ba431ad75] received 2024-02-23T03:39:01.159710620Z [2024-02-23 03:39:01,159: INFO/ForkPoolWorker-15] [6a6e72cb-9970-42f2-8eb8-419293473332] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:39:01.168182867Z [2024-02-23 03:39:01,167: INFO/ForkPoolWorker-16] [6a938519-e080-47ad-9c4b-ae266aeeb367] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:39:01.168208918Z [2024-02-23 03:39:01,167: INFO/ForkPoolWorker-1] [4d7634f4-a74a-41bb-9d8a-aa6ba431ad75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:39:01.455665122Z [2024-02-23 03:39:01,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:39:01.472291803Z [2024-02-23 03:39:01,469: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:39:01.519035343Z [2024-02-23 03:39:01,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:39:01.617660743Z [2024-02-23 03:39:01,617: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:39:01.621442024Z [2024-02-23 03:39:01,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:39:01.639780922Z [2024-02-23 03:39:01,639: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:39:01.641073991Z [2024-02-23 03:39:01,640: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:39:01.641247437Z [2024-02-23 03:39:01,641: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:39:01.641356483Z [2024-02-23 03:39:01,641: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:39:01.641579064Z [2024-02-23 03:39:01,641: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:39:01.732603915Z [2024-02-23 03:39:01,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:39:02.404284654Z [2024-02-23 03:39:02,403: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a6e72cb-9970-42f2-8eb8-419293473332] succeeded in 1.2522787890011386s: None 2024-02-23T03:39:02.695756695Z [2024-02-23 03:39:02,695: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:39:02.699322509Z [2024-02-23 03:39:02,698: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:39:02.728122972Z [2024-02-23 03:39:02,727: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:39:02.731255854Z [2024-02-23 03:39:02,730: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:39:02.731471292Z [2024-02-23 03:39:02,731: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:39:02.731752958Z [2024-02-23 03:39:02,731: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:39:02.731950586Z [2024-02-23 03:39:02,731: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:39:02.732414198Z [2024-02-23 03:39:02,732: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:39:02.732679449Z [2024-02-23 03:39:02,732: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:39:02.774584241Z [2024-02-23 03:39:02,774: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:39:02.778626869Z [2024-02-23 03:39:02,778: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:39:02.799335631Z [2024-02-23 03:39:02,799: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:39:02.800905355Z [2024-02-23 03:39:02,800: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:39:02.800945083Z [2024-02-23 03:39:02,800: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:39:02.801024430Z [2024-02-23 03:39:02,800: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:39:02.801037955Z [2024-02-23 03:39:02,800: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:39:02.802073888Z [2024-02-23 03:39:02,801: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:39:02.802133000Z [2024-02-23 03:39:02,802: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:39:02.821771387Z [2024-02-23 03:39:02,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:39:02.930543974Z [2024-02-23 03:39:02,930: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:39:06.048714290Z [2024-02-23 03:39:06,048: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d7634f4-a74a-41bb-9d8a-aa6ba431ad75] succeeded in 4.88864803999968s: None 2024-02-23T03:39:06.810229172Z [2024-02-23 03:39:06,809: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a938519-e080-47ad-9c4b-ae266aeeb367] succeeded in 5.654034404000413s: None 2024-02-23T03:40:00.443007748Z [2024-02-23 03:40:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8186dd00-4113-4f86-9aff-7f54ae6b6006] received 2024-02-23T03:40:00.445478635Z [2024-02-23 03:40:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99607ddf-c482-4bc2-a0ac-4670b6864589] received 2024-02-23T03:40:00.448706727Z [2024-02-23 03:40:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb0898e5-8e57-40d6-bfdc-9c27bdcb9ccd] received 2024-02-23T03:40:00.449268039Z [2024-02-23 03:40:00,449: INFO/ForkPoolWorker-15] [8186dd00-4113-4f86-9aff-7f54ae6b6006] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:40:00.452939954Z [2024-02-23 03:40:00,452: INFO/ForkPoolWorker-16] [99607ddf-c482-4bc2-a0ac-4670b6864589] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:40:00.456120201Z [2024-02-23 03:40:00,455: INFO/ForkPoolWorker-1] [bb0898e5-8e57-40d6-bfdc-9c27bdcb9ccd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:40:00.458937097Z [2024-02-23 03:40:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fda375b0-9205-4c50-a2ee-57ab5923485f] received 2024-02-23T03:40:00.461119777Z [2024-02-23 03:40:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1ca2bcd-229e-47cf-bc7f-809ff1789e9e] received 2024-02-23T03:40:00.468973115Z [2024-02-23 03:40:00,468: INFO/ForkPoolWorker-2] [fda375b0-9205-4c50-a2ee-57ab5923485f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:40:00.478640851Z [2024-02-23 03:40:00,478: INFO/ForkPoolWorker-3] [f1ca2bcd-229e-47cf-bc7f-809ff1789e9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:40:00.850320053Z [2024-02-23 03:40:00,844: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:40:00.920753229Z [2024-02-23 03:40:00,917: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:40:00.970485050Z [2024-02-23 03:40:00,966: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:40:00.974076723Z [2024-02-23 03:40:00,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:40:01.024586622Z [2024-02-23 03:40:01,016: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:40:01.099569405Z [2024-02-23 03:40:01,099: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T03:40:01.104358305Z [2024-02-23 03:40:01,103: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:01.167995321Z [2024-02-23 03:40:01,167: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:40:01.172053928Z [2024-02-23 03:40:01,171: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:40:01.172213439Z [2024-02-23 03:40:01,171: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:40:01.172403696Z [2024-02-23 03:40:01,172: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T03:40:01.172700428Z [2024-02-23 03:40:01,172: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:40:01.388544069Z [2024-02-23 03:40:01,375: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:01.619410920Z [2024-02-23 03:40:01,619: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:02.220420006Z [2024-02-23 03:40:02,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fda375b0-9205-4c50-a2ee-57ab5923485f] succeeded in 1.7598689639999066s: None 2024-02-23T03:40:02.290498655Z [2024-02-23 03:40:02,290: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:40:02.293705797Z [2024-02-23 03:40:02,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:02.315756094Z [2024-02-23 03:40:02,315: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:40:02.317105994Z [2024-02-23 03:40:02,316: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:40:02.317118340Z [2024-02-23 03:40:02,317: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:40:02.317371290Z [2024-02-23 03:40:02,317: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:40:02.317384413Z [2024-02-23 03:40:02,317: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:40:02.317677127Z [2024-02-23 03:40:02,317: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:40:02.317715698Z [2024-02-23 03:40:02,317: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:40:02.396849040Z [2024-02-23 03:40:02,396: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:02.516135291Z [2024-02-23 03:40:02,515: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f1ca2bcd-229e-47cf-bc7f-809ff1789e9e] succeeded in 2.052439081000557s: None 2024-02-23T03:40:02.528927140Z [2024-02-23 03:40:02,528: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:40:02.532067138Z [2024-02-23 03:40:02,531: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:02.559522900Z [2024-02-23 03:40:02,559: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:40:02.561563464Z [2024-02-23 03:40:02,561: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:40:02.561598703Z [2024-02-23 03:40:02,561: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:40:02.561831601Z [2024-02-23 03:40:02,561: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:40:02.561970358Z [2024-02-23 03:40:02,561: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:40:02.563330395Z [2024-02-23 03:40:02,563: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:40:02.563527682Z [2024-02-23 03:40:02,563: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:40:02.663501585Z [2024-02-23 03:40:02,663: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:40:02.667290692Z [2024-02-23 03:40:02,666: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:02.675270726Z [2024-02-23 03:40:02,674: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:02.699236947Z [2024-02-23 03:40:02,698: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:40:02.700462860Z [2024-02-23 03:40:02,700: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:40:02.700496442Z [2024-02-23 03:40:02,700: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:40:02.700634620Z [2024-02-23 03:40:02,700: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:40:02.700644023Z [2024-02-23 03:40:02,700: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:40:02.700883233Z [2024-02-23 03:40:02,700: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:40:02.700915303Z [2024-02-23 03:40:02,700: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:40:02.799524736Z [2024-02-23 03:40:02,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:03.440701084Z [2024-02-23 03:40:03,440: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99607ddf-c482-4bc2-a0ac-4670b6864589] succeeded in 2.9935814879991085s: None 2024-02-23T03:40:03.842550328Z [2024-02-23 03:40:03,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3c6e95b-4410-4693-95ac-5c27f219edeb] received 2024-02-23T03:40:03.856762077Z [2024-02-23 03:40:03,856: INFO/ForkPoolWorker-16] [c3c6e95b-4410-4693-95ac-5c27f219edeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:40:03.900444895Z [2024-02-23 03:40:03,899: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb0898e5-8e57-40d6-bfdc-9c27bdcb9ccd] succeeded in 3.448573416999352s: None 2024-02-23T03:40:04.126061016Z [2024-02-23 03:40:04,122: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:40:04.678069117Z [2024-02-23 03:40:04,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8186dd00-4113-4f86-9aff-7f54ae6b6006] succeeded in 4.233613989001242s: None 2024-02-23T03:40:05.473617438Z [2024-02-23 03:40:05,473: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:40:05.477164625Z [2024-02-23 03:40:05,476: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:05.498362537Z [2024-02-23 03:40:05,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:40:05.500602004Z [2024-02-23 03:40:05,500: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:40:05.500640451Z [2024-02-23 03:40:05,500: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:40:05.500651757Z [2024-02-23 03:40:05,500: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:40:05.500662271Z [2024-02-23 03:40:05,500: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:40:05.501176170Z [2024-02-23 03:40:05,500: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:40:05.501189091Z [2024-02-23 03:40:05,500: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:40:05.631949640Z [2024-02-23 03:40:05,631: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:06.382475799Z [2024-02-23 03:40:06,381: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3c6e95b-4410-4693-95ac-5c27f219edeb] succeeded in 2.538008538000213s: None 2024-02-23T03:40:07.319767112Z [2024-02-23 03:40:07,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2adaa3cf-bc65-4aa8-bce7-3ea4519cd938] received 2024-02-23T03:40:07.327452613Z [2024-02-23 03:40:07,327: INFO/ForkPoolWorker-15] [2adaa3cf-bc65-4aa8-bce7-3ea4519cd938] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:40:07.613510573Z [2024-02-23 03:40:07,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:40:08.834359100Z [2024-02-23 03:40:08,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:40:08.837821663Z [2024-02-23 03:40:08,837: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:08.860892060Z [2024-02-23 03:40:08,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:40:08.862261847Z [2024-02-23 03:40:08,862: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:40:08.862339719Z [2024-02-23 03:40:08,862: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:40:08.862551491Z [2024-02-23 03:40:08,862: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:40:08.862579647Z [2024-02-23 03:40:08,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:40:08.862933592Z [2024-02-23 03:40:08,862: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:40:08.863035333Z [2024-02-23 03:40:08,862: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:40:08.960263006Z [2024-02-23 03:40:08,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:10.496844336Z [2024-02-23 03:40:10,496: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2adaa3cf-bc65-4aa8-bce7-3ea4519cd938] succeeded in 3.1749167569996644s: None 2024-02-23T03:40:10.794739804Z [2024-02-23 03:40:10,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82356d83-e9bd-4ed0-ae72-0c8151a3c22e] received 2024-02-23T03:40:10.803695673Z [2024-02-23 03:40:10,803: INFO/ForkPoolWorker-15] [82356d83-e9bd-4ed0-ae72-0c8151a3c22e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:40:11.202297469Z [2024-02-23 03:40:11,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:40:12.305600835Z [2024-02-23 03:40:12,305: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:40:12.309156150Z [2024-02-23 03:40:12,308: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:40:12.331844810Z [2024-02-23 03:40:12,331: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:40:12.333647000Z [2024-02-23 03:40:12,333: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:40:12.333982213Z [2024-02-23 03:40:12,333: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:40:12.334361668Z [2024-02-23 03:40:12,334: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:40:12.334595936Z [2024-02-23 03:40:12,334: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:40:12.335164328Z [2024-02-23 03:40:12,334: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:40:12.335397801Z [2024-02-23 03:40:12,335: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:40:12.419715781Z [2024-02-23 03:40:12,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:40:12.988979362Z [2024-02-23 03:40:12,988: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82356d83-e9bd-4ed0-ae72-0c8151a3c22e] succeeded in 2.1924737139997887s: None 2024-02-23T03:41:00.374636783Z [2024-02-23 03:41:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb6e63f9-bc35-4968-b7f9-74f412fd5ef6] received 2024-02-23T03:41:00.377519835Z [2024-02-23 03:41:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b442c438-77ae-4385-8ace-90d6baa33114] received 2024-02-23T03:41:00.382273695Z [2024-02-23 03:41:00,381: INFO/ForkPoolWorker-15] [eb6e63f9-bc35-4968-b7f9-74f412fd5ef6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:41:00.385163678Z [2024-02-23 03:41:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab961a5d-c197-4942-a1d6-14a6ccd73fe8] received 2024-02-23T03:41:00.386942905Z [2024-02-23 03:41:00,385: INFO/ForkPoolWorker-16] [b442c438-77ae-4385-8ace-90d6baa33114] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:41:00.402700853Z [2024-02-23 03:41:00,402: INFO/ForkPoolWorker-1] [ab961a5d-c197-4942-a1d6-14a6ccd73fe8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:41:00.686451544Z [2024-02-23 03:41:00,683: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:41:00.694481187Z [2024-02-23 03:41:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:41:00.714150863Z [2024-02-23 03:41:00,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:41:00.861022991Z [2024-02-23 03:41:00,860: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:41:00.864965978Z [2024-02-23 03:41:00,864: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:41:00.891813619Z [2024-02-23 03:41:00,891: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:41:00.893860723Z [2024-02-23 03:41:00,893: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:41:00.894097845Z [2024-02-23 03:41:00,893: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:41:00.894418201Z [2024-02-23 03:41:00,893: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:41:00.894787871Z [2024-02-23 03:41:00,894: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:41:00.993474933Z [2024-02-23 03:41:00,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:41:01.563765317Z [2024-02-23 03:41:01,563: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b442c438-77ae-4385-8ace-90d6baa33114] succeeded in 1.1843840940000518s: None 2024-02-23T03:41:02.020874298Z [2024-02-23 03:41:02,020: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:41:02.024407438Z [2024-02-23 03:41:02,023: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:41:02.048455278Z [2024-02-23 03:41:02,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:41:02.049888684Z [2024-02-23 03:41:02,049: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:41:02.050027895Z [2024-02-23 03:41:02,049: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:41:02.050216342Z [2024-02-23 03:41:02,049: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:41:02.050352628Z [2024-02-23 03:41:02,050: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:41:02.051005251Z [2024-02-23 03:41:02,050: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:41:02.051100581Z [2024-02-23 03:41:02,050: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:41:02.055121374Z [2024-02-23 03:41:02,054: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:41:02.058435263Z [2024-02-23 03:41:02,057: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:41:02.084930292Z [2024-02-23 03:41:02,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:41:02.086483753Z [2024-02-23 03:41:02,086: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:41:02.086591487Z [2024-02-23 03:41:02,086: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:41:02.086807668Z [2024-02-23 03:41:02,086: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:41:02.086931584Z [2024-02-23 03:41:02,086: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:41:02.087252155Z [2024-02-23 03:41:02,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:41:02.087322670Z [2024-02-23 03:41:02,087: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:41:02.186640746Z [2024-02-23 03:41:02,186: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:41:02.217698195Z [2024-02-23 03:41:02,217: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:41:03.903310793Z [2024-02-23 03:41:03,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb6e63f9-bc35-4968-b7f9-74f412fd5ef6] succeeded in 3.5264973159992223s: None 2024-02-23T03:41:04.138958102Z [2024-02-23 03:41:04,138: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab961a5d-c197-4942-a1d6-14a6ccd73fe8] succeeded in 3.74661223899966s: None 2024-02-23T03:42:00.377665602Z [2024-02-23 03:42:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8a9435c-3c20-4330-9ccf-106ce09ad051] received 2024-02-23T03:42:00.380464706Z [2024-02-23 03:42:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a02bd91-394a-42f7-aed1-2399266d6e69] received 2024-02-23T03:42:00.387247172Z [2024-02-23 03:42:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2af9f98-b82b-4bb2-ae51-fa5e100bd2bb] received 2024-02-23T03:42:00.391088865Z [2024-02-23 03:42:00,390: INFO/ForkPoolWorker-15] [b8a9435c-3c20-4330-9ccf-106ce09ad051] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:42:00.392031779Z [2024-02-23 03:42:00,391: INFO/ForkPoolWorker-16] [6a02bd91-394a-42f7-aed1-2399266d6e69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:42:00.396496173Z [2024-02-23 03:42:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7242ba16-a60f-4b23-80ff-3da6f70c2a89] received 2024-02-23T03:42:00.407854475Z [2024-02-23 03:42:00,407: INFO/ForkPoolWorker-1] [f2af9f98-b82b-4bb2-ae51-fa5e100bd2bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:42:00.410582424Z [2024-02-23 03:42:00,410: INFO/ForkPoolWorker-2] [7242ba16-a60f-4b23-80ff-3da6f70c2a89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:42:00.702547965Z [2024-02-23 03:42:00,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:42:00.767707813Z [2024-02-23 03:42:00,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:42:00.774483249Z [2024-02-23 03:42:00,771: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:42:00.877408891Z [2024-02-23 03:42:00,859: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:42:00.950972663Z [2024-02-23 03:42:00,950: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:42:00.978093159Z [2024-02-23 03:42:00,977: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:42:00.982869359Z [2024-02-23 03:42:00,982: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:42:01.051674984Z [2024-02-23 03:42:01,051: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:42:01.055774235Z [2024-02-23 03:42:01,055: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:42:01.056278325Z [2024-02-23 03:42:01,055: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:42:01.056781152Z [2024-02-23 03:42:01,056: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:42:01.058581122Z [2024-02-23 03:42:01,057: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:42:01.173466660Z [2024-02-23 03:42:01,173: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:42:01.567822656Z [2024-02-23 03:42:01,567: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8a9435c-3c20-4330-9ccf-106ce09ad051] succeeded in 1.1861503239997546s: None 2024-02-23T03:42:01.785731286Z [2024-02-23 03:42:01,785: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7242ba16-a60f-4b23-80ff-3da6f70c2a89] succeeded in 1.3874616220000462s: None 2024-02-23T03:42:02.078694361Z [2024-02-23 03:42:02,078: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:42:02.082325987Z [2024-02-23 03:42:02,081: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:42:02.110896858Z [2024-02-23 03:42:02,110: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:42:02.112841696Z [2024-02-23 03:42:02,112: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:42:02.112982080Z [2024-02-23 03:42:02,112: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:42:02.113262276Z [2024-02-23 03:42:02,113: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:42:02.113398446Z [2024-02-23 03:42:02,113: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:42:02.113803358Z [2024-02-23 03:42:02,113: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:42:02.114503090Z [2024-02-23 03:42:02,114: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:42:02.183671060Z [2024-02-23 03:42:02,183: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:42:02.190911172Z [2024-02-23 03:42:02,190: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:42:02.210156742Z [2024-02-23 03:42:02,209: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:42:02.216560402Z [2024-02-23 03:42:02,216: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:42:02.217914085Z [2024-02-23 03:42:02,217: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:42:02.218140423Z [2024-02-23 03:42:02,217: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:42:02.218782893Z [2024-02-23 03:42:02,218: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:42:02.219989227Z [2024-02-23 03:42:02,218: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:42:02.220379571Z [2024-02-23 03:42:02,220: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:42:02.220541590Z [2024-02-23 03:42:02,220: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:42:02.296646676Z [2024-02-23 03:42:02,296: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:42:04.265538314Z [2024-02-23 03:42:04,265: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2af9f98-b82b-4bb2-ae51-fa5e100bd2bb] succeeded in 3.8659432059994288s: None 2024-02-23T03:42:04.268742774Z [2024-02-23 03:42:04,268: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a02bd91-394a-42f7-aed1-2399266d6e69] succeeded in 3.8867420380011026s: None 2024-02-23T03:43:00.335356577Z [2024-02-23 03:43:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[784b723d-2dfc-4911-ad54-7ef290170f6d] received 2024-02-23T03:43:00.340472170Z [2024-02-23 03:43:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c41116-dad4-4670-9511-233678d4e3f1] received 2024-02-23T03:43:00.341502730Z [2024-02-23 03:43:00,341: INFO/ForkPoolWorker-15] [784b723d-2dfc-4911-ad54-7ef290170f6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:43:00.344749550Z [2024-02-23 03:43:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a996188-0bb7-42de-8881-74365e99c1f3] received 2024-02-23T03:43:00.345912193Z [2024-02-23 03:43:00,345: INFO/ForkPoolWorker-16] [95c41116-dad4-4670-9511-233678d4e3f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:43:00.351317536Z [2024-02-23 03:43:00,351: INFO/ForkPoolWorker-1] [4a996188-0bb7-42de-8881-74365e99c1f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:43:00.632225241Z [2024-02-23 03:43:00,629: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:43:00.693524313Z [2024-02-23 03:43:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:43:00.698064007Z [2024-02-23 03:43:00,695: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:43:00.857109620Z [2024-02-23 03:43:00,856: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:43:00.861612352Z [2024-02-23 03:43:00,861: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:43:00.885021563Z [2024-02-23 03:43:00,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:43:00.886621979Z [2024-02-23 03:43:00,886: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:43:00.886746728Z [2024-02-23 03:43:00,886: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:43:00.886915940Z [2024-02-23 03:43:00,886: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:43:00.887234914Z [2024-02-23 03:43:00,887: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:43:00.978041223Z [2024-02-23 03:43:00,977: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:43:01.822937759Z [2024-02-23 03:43:01,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95c41116-dad4-4670-9511-233678d4e3f1] succeeded in 1.4812109230006172s: None 2024-02-23T03:43:01.994658571Z [2024-02-23 03:43:01,994: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:43:01.997993613Z [2024-02-23 03:43:01,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:43:02.015032935Z [2024-02-23 03:43:02,014: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:43:02.017158580Z [2024-02-23 03:43:02,016: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:43:02.018416280Z [2024-02-23 03:43:02,018: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:43:02.018429248Z [2024-02-23 03:43:02,018: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:43:02.018621187Z [2024-02-23 03:43:02,018: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:43:02.018672567Z [2024-02-23 03:43:02,018: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:43:02.018913543Z [2024-02-23 03:43:02,018: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:43:02.019036368Z [2024-02-23 03:43:02,018: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:43:02.019132520Z [2024-02-23 03:43:02,019: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:43:02.040318444Z [2024-02-23 03:43:02,040: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:43:02.041847364Z [2024-02-23 03:43:02,041: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:43:02.042033858Z [2024-02-23 03:43:02,041: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:43:02.042281923Z [2024-02-23 03:43:02,042: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:43:02.042367834Z [2024-02-23 03:43:02,042: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:43:02.042629767Z [2024-02-23 03:43:02,042: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:43:02.042703385Z [2024-02-23 03:43:02,042: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:43:02.101607131Z [2024-02-23 03:43:02,101: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:43:02.140314010Z [2024-02-23 03:43:02,139: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:43:03.850484302Z [2024-02-23 03:43:03,847: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a996188-0bb7-42de-8881-74365e99c1f3] succeeded in 3.5017735790006554s: None 2024-02-23T03:43:04.253997187Z [2024-02-23 03:43:04,253: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[784b723d-2dfc-4911-ad54-7ef290170f6d] succeeded in 3.916850734000036s: None 2024-02-23T03:44:01.285749517Z [2024-02-23 03:44:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef9447f4-6ace-4a13-b8f3-f2ae33b03f38] received 2024-02-23T03:44:01.288651048Z [2024-02-23 03:44:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[791788e7-8929-4976-b2e1-bd5288f79868] received 2024-02-23T03:44:01.296673756Z [2024-02-23 03:44:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[defcf315-c6d5-4707-81ac-a8b9e6a29333] received 2024-02-23T03:44:01.297652395Z [2024-02-23 03:44:01,297: INFO/ForkPoolWorker-16] [791788e7-8929-4976-b2e1-bd5288f79868] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:44:01.299756288Z [2024-02-23 03:44:01,299: INFO/ForkPoolWorker-15] [ef9447f4-6ace-4a13-b8f3-f2ae33b03f38] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:44:01.301327465Z [2024-02-23 03:44:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33bd8d96-58f5-45b1-8112-7e8555039623] received 2024-02-23T03:44:01.313272573Z [2024-02-23 03:44:01,312: INFO/ForkPoolWorker-1] [defcf315-c6d5-4707-81ac-a8b9e6a29333] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:44:01.313446283Z [2024-02-23 03:44:01,313: INFO/ForkPoolWorker-2] [33bd8d96-58f5-45b1-8112-7e8555039623] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:44:01.627730412Z [2024-02-23 03:44:01,624: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:44:01.670484268Z [2024-02-23 03:44:01,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:44:01.707266108Z [2024-02-23 03:44:01,702: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:44:01.843661732Z [2024-02-23 03:44:01,828: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:44:01.960397853Z [2024-02-23 03:44:01,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:44:02.040317509Z [2024-02-23 03:44:02,039: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:44:02.044962228Z [2024-02-23 03:44:02,044: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:44:02.072700664Z [2024-02-23 03:44:02,072: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:44:02.073690081Z [2024-02-23 03:44:02,073: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:44:02.073871414Z [2024-02-23 03:44:02,073: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:44:02.073996182Z [2024-02-23 03:44:02,073: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:44:02.074273373Z [2024-02-23 03:44:02,074: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:44:02.161176857Z [2024-02-23 03:44:02,160: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:44:02.581023388Z [2024-02-23 03:44:02,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef9447f4-6ace-4a13-b8f3-f2ae33b03f38] succeeded in 1.2907246369995846s: None 2024-02-23T03:44:02.750667048Z [2024-02-23 03:44:02,750: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[33bd8d96-58f5-45b1-8112-7e8555039623] succeeded in 1.446787528000641s: None 2024-02-23T03:44:02.901961298Z [2024-02-23 03:44:02,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:44:02.906386921Z [2024-02-23 03:44:02,905: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:44:02.939536686Z [2024-02-23 03:44:02,939: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:44:02.945053462Z [2024-02-23 03:44:02,944: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:44:02.945074110Z [2024-02-23 03:44:02,944: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:44:02.945183819Z [2024-02-23 03:44:02,945: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:44:02.945211851Z [2024-02-23 03:44:02,945: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:44:02.946738091Z [2024-02-23 03:44:02,945: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:44:02.946778195Z [2024-02-23 03:44:02,946: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:44:03.060417186Z [2024-02-23 03:44:03,060: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:44:03.065936583Z [2024-02-23 03:44:03,065: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:44:03.103233440Z [2024-02-23 03:44:03,103: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:44:03.107519312Z [2024-02-23 03:44:03,107: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:44:03.107720411Z [2024-02-23 03:44:03,107: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:44:03.108955297Z [2024-02-23 03:44:03,108: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:44:03.109130223Z [2024-02-23 03:44:03,108: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:44:03.109687445Z [2024-02-23 03:44:03,109: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:44:03.110674900Z [2024-02-23 03:44:03,109: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:44:03.136681167Z [2024-02-23 03:44:03,136: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:44:03.233101660Z [2024-02-23 03:44:03,232: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:44:05.570296703Z [2024-02-23 03:44:05,569: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[defcf315-c6d5-4707-81ac-a8b9e6a29333] succeeded in 4.267372742000589s: None 2024-02-23T03:44:05.689701626Z [2024-02-23 03:44:05,689: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[791788e7-8929-4976-b2e1-bd5288f79868] succeeded in 4.399330206000741s: None 2024-02-23T03:45:01.246794765Z [2024-02-23 03:45:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68e84a32-a9d6-4ddb-ba23-4ef15e9b0e29] received 2024-02-23T03:45:01.251422774Z [2024-02-23 03:45:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaaa6838-383e-446e-9499-aedddb930517] received 2024-02-23T03:45:01.254623420Z [2024-02-23 03:45:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e4e0243-6a16-4574-8b61-4af89cbbd60a] received 2024-02-23T03:45:01.255843390Z [2024-02-23 03:45:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8f666b9-020e-433b-8e19-a3c4e4198d4b] received 2024-02-23T03:45:01.261567783Z [2024-02-23 03:45:01,261: INFO/ForkPoolWorker-2] [d8f666b9-020e-433b-8e19-a3c4e4198d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:45:01.269464451Z [2024-02-23 03:45:01,268: INFO/ForkPoolWorker-1] [4e4e0243-6a16-4574-8b61-4af89cbbd60a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:45:01.272657095Z [2024-02-23 03:45:01,272: INFO/ForkPoolWorker-15] [68e84a32-a9d6-4ddb-ba23-4ef15e9b0e29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:45:01.275960915Z [2024-02-23 03:45:01,275: INFO/ForkPoolWorker-16] [aaaa6838-383e-446e-9499-aedddb930517] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:45:01.599445393Z [2024-02-23 03:45:01,596: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:45:01.609277411Z [2024-02-23 03:45:01,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:45:01.766034307Z [2024-02-23 03:45:01,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:45:01.771588871Z [2024-02-23 03:45:01,771: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:45:01.775591858Z [2024-02-23 03:45:01,775: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:01.827898768Z [2024-02-23 03:45:01,827: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:45:01.831827848Z [2024-02-23 03:45:01,831: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:45:01.831997939Z [2024-02-23 03:45:01,831: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:45:01.832058883Z [2024-02-23 03:45:01,831: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:45:01.832327294Z [2024-02-23 03:45:01,832: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:45:01.871192005Z [2024-02-23 03:45:01,867: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:45:02.009808105Z [2024-02-23 03:45:02,009: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:02.677267513Z [2024-02-23 03:45:02,676: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d8f666b9-020e-433b-8e19-a3c4e4198d4b] succeeded in 1.4203895720002038s: None 2024-02-23T03:45:03.157550676Z [2024-02-23 03:45:03,157: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:45:03.161279626Z [2024-02-23 03:45:03,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:03.184745685Z [2024-02-23 03:45:03,184: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:45:03.186306168Z [2024-02-23 03:45:03,186: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:45:03.186458661Z [2024-02-23 03:45:03,186: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:45:03.186648956Z [2024-02-23 03:45:03,186: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:45:03.186774814Z [2024-02-23 03:45:03,186: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:45:03.187104967Z [2024-02-23 03:45:03,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:45:03.187601987Z [2024-02-23 03:45:03,187: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:45:03.269803254Z [2024-02-23 03:45:03,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:03.309658818Z [2024-02-23 03:45:03,309: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:45:03.313103788Z [2024-02-23 03:45:03,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:03.342182378Z [2024-02-23 03:45:03,341: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:45:03.343420229Z [2024-02-23 03:45:03,343: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:45:03.343933665Z [2024-02-23 03:45:03,343: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:45:03.344142113Z [2024-02-23 03:45:03,343: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:45:03.344499000Z [2024-02-23 03:45:03,344: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:45:03.344640211Z [2024-02-23 03:45:03,344: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:45:03.345111274Z [2024-02-23 03:45:03,344: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:45:03.345365014Z [2024-02-23 03:45:03,345: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:45:03.347206429Z [2024-02-23 03:45:03,346: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:03.371435156Z [2024-02-23 03:45:03,371: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:45:03.372817352Z [2024-02-23 03:45:03,372: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:45:03.372847151Z [2024-02-23 03:45:03,372: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:45:03.373053797Z [2024-02-23 03:45:03,372: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:45:03.373109510Z [2024-02-23 03:45:03,373: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:45:03.373580900Z [2024-02-23 03:45:03,373: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:45:03.373736826Z [2024-02-23 03:45:03,373: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:45:03.441602233Z [2024-02-23 03:45:03,440: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:03.473806842Z [2024-02-23 03:45:03,473: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:03.978148338Z [2024-02-23 03:45:03,977: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68e84a32-a9d6-4ddb-ba23-4ef15e9b0e29] succeeded in 2.722710743000789s: None 2024-02-23T03:45:04.848633796Z [2024-02-23 03:45:04,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b213f9b-b82f-4357-b4ee-88fd058ff1be] received 2024-02-23T03:45:04.867722742Z [2024-02-23 03:45:04,867: INFO/ForkPoolWorker-15] [2b213f9b-b82f-4357-b4ee-88fd058ff1be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:45:05.198892753Z [2024-02-23 03:45:05,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:45:05.499213134Z [2024-02-23 03:45:05,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e4e0243-6a16-4574-8b61-4af89cbbd60a] succeeded in 4.241768810999929s: None 2024-02-23T03:45:05.990778942Z [2024-02-23 03:45:05,990: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aaaa6838-383e-446e-9499-aedddb930517] succeeded in 4.736021714999879s: None 2024-02-23T03:45:06.494425125Z [2024-02-23 03:45:06,493: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:45:06.497805936Z [2024-02-23 03:45:06,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:06.516504954Z [2024-02-23 03:45:06,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:45:06.517901729Z [2024-02-23 03:45:06,517: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:45:06.517918537Z [2024-02-23 03:45:06,517: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:45:06.518093594Z [2024-02-23 03:45:06,517: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:45:06.518140774Z [2024-02-23 03:45:06,518: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:45:06.518484538Z [2024-02-23 03:45:06,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:45:06.518509150Z [2024-02-23 03:45:06,518: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:45:06.606799477Z [2024-02-23 03:45:06,606: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:07.243082035Z [2024-02-23 03:45:07,242: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b213f9b-b82f-4357-b4ee-88fd058ff1be] succeeded in 2.3911049220005225s: None 2024-02-23T03:45:07.999245704Z [2024-02-23 03:45:07,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cbd1b48-f001-4008-b631-1e6dbadba4e1] received 2024-02-23T03:45:08.013075763Z [2024-02-23 03:45:08,012: INFO/ForkPoolWorker-15] [3cbd1b48-f001-4008-b631-1e6dbadba4e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:45:08.307710408Z [2024-02-23 03:45:08,304: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:45:09.472248398Z [2024-02-23 03:45:09,471: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:45:09.475671701Z [2024-02-23 03:45:09,475: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:09.507977078Z [2024-02-23 03:45:09,507: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:45:09.509123979Z [2024-02-23 03:45:09,508: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:45:09.509145205Z [2024-02-23 03:45:09,508: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:45:09.509171747Z [2024-02-23 03:45:09,509: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:45:09.509231944Z [2024-02-23 03:45:09,509: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:45:09.509529933Z [2024-02-23 03:45:09,509: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:45:09.509559132Z [2024-02-23 03:45:09,509: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:45:09.636261192Z [2024-02-23 03:45:09,635: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:11.235004924Z [2024-02-23 03:45:11,234: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3cbd1b48-f001-4008-b631-1e6dbadba4e1] succeeded in 3.2309294609985955s: None 2024-02-23T03:45:11.495587670Z [2024-02-23 03:45:11,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f943cb63-bd35-47c0-bcf4-ac9cbd6218a8] received 2024-02-23T03:45:11.506156781Z [2024-02-23 03:45:11,505: INFO/ForkPoolWorker-15] [f943cb63-bd35-47c0-bcf4-ac9cbd6218a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:45:11.779263858Z [2024-02-23 03:45:11,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:45:12.893161493Z [2024-02-23 03:45:12,892: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:45:12.896351587Z [2024-02-23 03:45:12,895: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:45:12.911504209Z [2024-02-23 03:45:12,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:45:12.912796248Z [2024-02-23 03:45:12,912: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:45:12.912943307Z [2024-02-23 03:45:12,912: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:45:12.913130321Z [2024-02-23 03:45:12,912: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:45:12.913238086Z [2024-02-23 03:45:12,913: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:45:12.913624441Z [2024-02-23 03:45:12,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:45:12.913650808Z [2024-02-23 03:45:12,913: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:45:12.998594490Z [2024-02-23 03:45:12,998: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:45:13.519569243Z [2024-02-23 03:45:13,519: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f943cb63-bd35-47c0-bcf4-ac9cbd6218a8] succeeded in 2.020865070999207s: None 2024-02-23T03:46:00.472404929Z [2024-02-23 03:46:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f6895e3-c7f8-422f-93ff-77b5bb7c6f05] received 2024-02-23T03:46:00.480795299Z [2024-02-23 03:46:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[597f075d-4493-4394-a631-70d4202b5560] received 2024-02-23T03:46:00.482442857Z [2024-02-23 03:46:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8a9c867-595b-46d0-b582-b68118a1948b] received 2024-02-23T03:46:00.482536679Z [2024-02-23 03:46:00,482: INFO/ForkPoolWorker-15] [6f6895e3-c7f8-422f-93ff-77b5bb7c6f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:46:00.486896332Z [2024-02-23 03:46:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8b0fec4-c62d-4c6d-8dd7-2d1ccbcb1f00] received 2024-02-23T03:46:00.494570209Z [2024-02-23 03:46:00,494: INFO/ForkPoolWorker-2] [b8b0fec4-c62d-4c6d-8dd7-2d1ccbcb1f00] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:46:00.504712870Z [2024-02-23 03:46:00,504: INFO/ForkPoolWorker-1] [b8a9c867-595b-46d0-b582-b68118a1948b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:46:00.506324989Z [2024-02-23 03:46:00,506: INFO/ForkPoolWorker-16] [597f075d-4493-4394-a631-70d4202b5560] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:46:00.873905785Z [2024-02-23 03:46:00,864: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:46:01.023059015Z [2024-02-23 03:46:01,019: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:46:01.055212075Z [2024-02-23 03:46:01,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:46:01.156051538Z [2024-02-23 03:46:01,151: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:46:01.214099123Z [2024-02-23 03:46:01,213: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:46:01.219801748Z [2024-02-23 03:46:01,218: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:46:01.258471975Z [2024-02-23 03:46:01,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:46:01.260609524Z [2024-02-23 03:46:01,260: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:46:01.260896701Z [2024-02-23 03:46:01,260: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:46:01.261087141Z [2024-02-23 03:46:01,260: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:46:01.261513361Z [2024-02-23 03:46:01,261: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:46:01.360581123Z [2024-02-23 03:46:01,360: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:46:01.750799534Z [2024-02-23 03:46:01,750: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:46:02.114138750Z [2024-02-23 03:46:02,113: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b8b0fec4-c62d-4c6d-8dd7-2d1ccbcb1f00] succeeded in 1.625783469000453s: None 2024-02-23T03:46:02.520519811Z [2024-02-23 03:46:02,519: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f6895e3-c7f8-422f-93ff-77b5bb7c6f05] succeeded in 2.045963553000547s: None 2024-02-23T03:46:02.649561410Z [2024-02-23 03:46:02,648: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:46:02.654345323Z [2024-02-23 03:46:02,653: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:46:02.692208901Z [2024-02-23 03:46:02,691: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:46:02.695699835Z [2024-02-23 03:46:02,695: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:46:02.695740923Z [2024-02-23 03:46:02,695: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:46:02.695886504Z [2024-02-23 03:46:02,695: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:46:02.695950331Z [2024-02-23 03:46:02,695: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:46:02.696283954Z [2024-02-23 03:46:02,696: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:46:02.696330377Z [2024-02-23 03:46:02,696: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:46:02.712256042Z [2024-02-23 03:46:02,711: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:46:02.716020374Z [2024-02-23 03:46:02,715: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:46:02.762728399Z [2024-02-23 03:46:02,762: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:46:02.764995655Z [2024-02-23 03:46:02,764: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:46:02.765205987Z [2024-02-23 03:46:02,765: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:46:02.765516825Z [2024-02-23 03:46:02,765: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:46:02.765775927Z [2024-02-23 03:46:02,765: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:46:02.766208056Z [2024-02-23 03:46:02,766: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:46:02.766420175Z [2024-02-23 03:46:02,766: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:46:02.795566434Z [2024-02-23 03:46:02,795: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:46:02.873190188Z [2024-02-23 03:46:02,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:46:04.347024770Z [2024-02-23 03:46:04,346: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8a9c867-595b-46d0-b582-b68118a1948b] succeeded in 3.861384560999795s: None 2024-02-23T03:46:05.040343909Z [2024-02-23 03:46:05,039: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[597f075d-4493-4394-a631-70d4202b5560] succeeded in 4.556673500001125s: None 2024-02-23T03:47:00.783291053Z [2024-02-23 03:47:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2df2c20-bc44-4ebe-b5cb-25137543ab69] received 2024-02-23T03:47:00.790040560Z [2024-02-23 03:47:00,789: INFO/ForkPoolWorker-15] [b2df2c20-bc44-4ebe-b5cb-25137543ab69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:47:00.798672120Z [2024-02-23 03:47:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[017fbda0-4f34-4280-aaca-205d6fcd65b2] received 2024-02-23T03:47:00.801933150Z [2024-02-23 03:47:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fa0fa24-fa0f-49f8-a99d-d41ba12ca7b7] received 2024-02-23T03:47:00.807623920Z [2024-02-23 03:47:00,807: INFO/ForkPoolWorker-1] [8fa0fa24-fa0f-49f8-a99d-d41ba12ca7b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:47:00.807927168Z [2024-02-23 03:47:00,807: INFO/ForkPoolWorker-16] [017fbda0-4f34-4280-aaca-205d6fcd65b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:47:01.125282306Z [2024-02-23 03:47:01,121: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:47:01.188402467Z [2024-02-23 03:47:01,184: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:47:01.235718659Z [2024-02-23 03:47:01,230: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:47:01.456782677Z [2024-02-23 03:47:01,456: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:47:01.462040240Z [2024-02-23 03:47:01,461: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:47:01.497319880Z [2024-02-23 03:47:01,497: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:47:01.503133376Z [2024-02-23 03:47:01,498: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:47:01.504787738Z [2024-02-23 03:47:01,504: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:47:01.504862772Z [2024-02-23 03:47:01,504: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:47:01.505188644Z [2024-02-23 03:47:01,505: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:47:01.602279996Z [2024-02-23 03:47:01,602: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:47:02.324580650Z [2024-02-23 03:47:02,324: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fa0fa24-fa0f-49f8-a99d-d41ba12ca7b7] succeeded in 1.521261036001306s: None 2024-02-23T03:47:02.463740081Z [2024-02-23 03:47:02,463: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:47:02.467196855Z [2024-02-23 03:47:02,466: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:47:02.485925228Z [2024-02-23 03:47:02,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:47:02.490217210Z [2024-02-23 03:47:02,489: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:47:02.492157506Z [2024-02-23 03:47:02,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:47:02.496314143Z [2024-02-23 03:47:02,495: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:47:02.496340728Z [2024-02-23 03:47:02,496: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:47:02.496400393Z [2024-02-23 03:47:02,496: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:47:02.496476259Z [2024-02-23 03:47:02,496: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:47:02.496779625Z [2024-02-23 03:47:02,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:47:02.496826158Z [2024-02-23 03:47:02,496: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:47:02.531928379Z [2024-02-23 03:47:02,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:47:02.535447123Z [2024-02-23 03:47:02,535: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:47:02.535470678Z [2024-02-23 03:47:02,535: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:47:02.535601835Z [2024-02-23 03:47:02,535: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:47:02.535750558Z [2024-02-23 03:47:02,535: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:47:02.536061371Z [2024-02-23 03:47:02,535: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:47:02.536130168Z [2024-02-23 03:47:02,536: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:47:02.599047474Z [2024-02-23 03:47:02,598: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:47:02.623728878Z [2024-02-23 03:47:02,623: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:47:04.266931219Z [2024-02-23 03:47:04,266: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2df2c20-bc44-4ebe-b5cb-25137543ab69] succeeded in 3.4820461950002937s: None 2024-02-23T03:47:04.665315323Z [2024-02-23 03:47:04,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[017fbda0-4f34-4280-aaca-205d6fcd65b2] succeeded in 3.865134260000559s: None 2024-02-23T03:48:00.649901066Z [2024-02-23 03:48:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[378849b0-3f2f-4968-83fc-59eb8293bcfe] received 2024-02-23T03:48:00.652288876Z [2024-02-23 03:48:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7960bced-c537-424c-ad08-85bda366912e] received 2024-02-23T03:48:00.658241955Z [2024-02-23 03:48:00,657: INFO/ForkPoolWorker-15] [378849b0-3f2f-4968-83fc-59eb8293bcfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:48:00.661410717Z [2024-02-23 03:48:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2c070e7-5bf0-4e93-b06f-c6e15e685e50] received 2024-02-23T03:48:00.662330651Z [2024-02-23 03:48:00,662: INFO/ForkPoolWorker-16] [7960bced-c537-424c-ad08-85bda366912e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:48:00.671851323Z [2024-02-23 03:48:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cca1561-3fc5-41ca-aa51-b2ebb97d2ab1] received 2024-02-23T03:48:00.687595396Z [2024-02-23 03:48:00,687: INFO/ForkPoolWorker-2] [0cca1561-3fc5-41ca-aa51-b2ebb97d2ab1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:48:00.691584654Z [2024-02-23 03:48:00,691: INFO/ForkPoolWorker-1] [e2c070e7-5bf0-4e93-b06f-c6e15e685e50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:48:01.057345439Z [2024-02-23 03:48:01,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:48:01.068707484Z [2024-02-23 03:48:01,065: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:48:01.134105231Z [2024-02-23 03:48:01,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:48:01.200033753Z [2024-02-23 03:48:01,196: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:48:01.274189048Z [2024-02-23 03:48:01,273: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:48:01.278210409Z [2024-02-23 03:48:01,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:48:01.309969107Z [2024-02-23 03:48:01,309: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:48:01.313441257Z [2024-02-23 03:48:01,313: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:48:01.313485364Z [2024-02-23 03:48:01,313: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:48:01.313578256Z [2024-02-23 03:48:01,313: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:48:01.313884312Z [2024-02-23 03:48:01,313: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:48:01.414641126Z [2024-02-23 03:48:01,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:48:01.472487396Z [2024-02-23 03:48:01,472: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:48:02.079119799Z [2024-02-23 03:48:02,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[378849b0-3f2f-4968-83fc-59eb8293bcfe] succeeded in 1.4268349550002313s: None 2024-02-23T03:48:02.234536865Z [2024-02-23 03:48:02,234: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0cca1561-3fc5-41ca-aa51-b2ebb97d2ab1] succeeded in 1.5602854429998843s: None 2024-02-23T03:48:02.347972276Z [2024-02-23 03:48:02,347: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:48:02.351394324Z [2024-02-23 03:48:02,350: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:48:02.377591938Z [2024-02-23 03:48:02,377: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:48:02.379293015Z [2024-02-23 03:48:02,379: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:48:02.379316554Z [2024-02-23 03:48:02,379: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:48:02.379486415Z [2024-02-23 03:48:02,379: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:48:02.379523232Z [2024-02-23 03:48:02,379: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:48:02.379818967Z [2024-02-23 03:48:02,379: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:48:02.379862414Z [2024-02-23 03:48:02,379: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:48:02.477016490Z [2024-02-23 03:48:02,476: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:48:02.622584666Z [2024-02-23 03:48:02,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:48:02.626083962Z [2024-02-23 03:48:02,625: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:48:02.650532405Z [2024-02-23 03:48:02,650: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:48:02.654098885Z [2024-02-23 03:48:02,653: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:48:02.654169989Z [2024-02-23 03:48:02,653: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:48:02.654309116Z [2024-02-23 03:48:02,654: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:48:02.654454945Z [2024-02-23 03:48:02,654: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:48:02.654902793Z [2024-02-23 03:48:02,654: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:48:02.655086476Z [2024-02-23 03:48:02,654: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:48:02.781533448Z [2024-02-23 03:48:02,781: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:48:04.121161529Z [2024-02-23 03:48:04,120: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e2c070e7-5bf0-4e93-b06f-c6e15e685e50] succeeded in 3.453626256001371s: None 2024-02-23T03:48:05.076814956Z [2024-02-23 03:48:05,076: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7960bced-c537-424c-ad08-85bda366912e] succeeded in 4.420759254999211s: None 2024-02-23T03:49:00.440150169Z [2024-02-23 03:49:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[764b1fc8-4cf9-4dab-a188-f04239edc2d6] received 2024-02-23T03:49:00.447535510Z [2024-02-23 03:49:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6796078b-7d2d-4c39-8ceb-10c65ec61929] received 2024-02-23T03:49:00.448765984Z [2024-02-23 03:49:00,448: INFO/ForkPoolWorker-15] [764b1fc8-4cf9-4dab-a188-f04239edc2d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:49:00.459126539Z [2024-02-23 03:49:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51f023fe-ea7d-4b07-adc0-125cf4e9881e] received 2024-02-23T03:49:00.464684880Z [2024-02-23 03:49:00,464: INFO/ForkPoolWorker-16] [6796078b-7d2d-4c39-8ceb-10c65ec61929] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:49:00.465194919Z [2024-02-23 03:49:00,464: INFO/ForkPoolWorker-1] [51f023fe-ea7d-4b07-adc0-125cf4e9881e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:49:00.747439817Z [2024-02-23 03:49:00,743: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:49:00.755210301Z [2024-02-23 03:49:00,752: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:49:00.796572582Z [2024-02-23 03:49:00,792: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:49:00.982196140Z [2024-02-23 03:49:00,981: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:49:00.986564339Z [2024-02-23 03:49:00,986: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:49:01.011018873Z [2024-02-23 03:49:01,010: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:49:01.012376286Z [2024-02-23 03:49:01,012: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:49:01.012526400Z [2024-02-23 03:49:01,012: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:49:01.012603568Z [2024-02-23 03:49:01,012: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:49:01.012923738Z [2024-02-23 03:49:01,012: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:49:01.113009284Z [2024-02-23 03:49:01,112: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:49:01.773398139Z [2024-02-23 03:49:01,772: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51f023fe-ea7d-4b07-adc0-125cf4e9881e] succeeded in 1.3122108090010443s: None 2024-02-23T03:49:01.899753826Z [2024-02-23 03:49:01,899: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:49:01.903060746Z [2024-02-23 03:49:01,902: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:49:01.924870992Z [2024-02-23 03:49:01,924: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:49:01.926330915Z [2024-02-23 03:49:01,926: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:49:01.926461765Z [2024-02-23 03:49:01,926: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:49:01.926487227Z [2024-02-23 03:49:01,926: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:49:01.926498385Z [2024-02-23 03:49:01,926: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:49:01.926709187Z [2024-02-23 03:49:01,926: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:49:01.926893602Z [2024-02-23 03:49:01,926: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:49:02.036934065Z [2024-02-23 03:49:02,036: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:49:02.038004841Z [2024-02-23 03:49:02,037: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:49:02.040451183Z [2024-02-23 03:49:02,039: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:49:02.068798805Z [2024-02-23 03:49:02,068: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:49:02.070188702Z [2024-02-23 03:49:02,069: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:49:02.070214370Z [2024-02-23 03:49:02,070: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:49:02.070574170Z [2024-02-23 03:49:02,070: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:49:02.070594122Z [2024-02-23 03:49:02,070: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:49:02.071282270Z [2024-02-23 03:49:02,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:49:02.071351591Z [2024-02-23 03:49:02,071: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:49:02.158116630Z [2024-02-23 03:49:02,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:49:03.929847753Z [2024-02-23 03:49:03,929: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6796078b-7d2d-4c39-8ceb-10c65ec61929] succeeded in 3.4735908079983346s: None 2024-02-23T03:49:04.615679539Z [2024-02-23 03:49:04,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[764b1fc8-4cf9-4dab-a188-f04239edc2d6] succeeded in 4.173146267999982s: None 2024-02-23T03:50:00.415332180Z [2024-02-23 03:50:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60d96156-8b60-4580-b573-ae6a69fc3edc] received 2024-02-23T03:50:00.417557777Z [2024-02-23 03:50:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cec615d3-a900-448d-82c5-60e925accc00] received 2024-02-23T03:50:00.422643212Z [2024-02-23 03:50:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bc7974d-44d0-42d0-b2ea-e422de6724bc] received 2024-02-23T03:50:00.427787188Z [2024-02-23 03:50:00,427: INFO/ForkPoolWorker-15] [60d96156-8b60-4580-b573-ae6a69fc3edc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:50:00.428444618Z [2024-02-23 03:50:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43f08dee-919a-4a67-9310-3e2eea714de9] received 2024-02-23T03:50:00.429549925Z [2024-02-23 03:50:00,429: INFO/ForkPoolWorker-16] [cec615d3-a900-448d-82c5-60e925accc00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:50:00.431983490Z [2024-02-23 03:50:00,431: INFO/ForkPoolWorker-1] [6bc7974d-44d0-42d0-b2ea-e422de6724bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:50:00.435520585Z [2024-02-23 03:50:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd2b8986-0587-4676-ba04-fbb1d41f9694] received 2024-02-23T03:50:00.440657953Z [2024-02-23 03:50:00,440: INFO/ForkPoolWorker-2] [43f08dee-919a-4a67-9310-3e2eea714de9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:50:00.445450819Z [2024-02-23 03:50:00,445: INFO/ForkPoolWorker-3] [cd2b8986-0587-4676-ba04-fbb1d41f9694] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:50:00.718581515Z [2024-02-23 03:50:00,715: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:50:00.848194206Z [2024-02-23 03:50:00,845: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:50:00.876583910Z [2024-02-23 03:50:00,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:50:00.885950812Z [2024-02-23 03:50:00,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:50:00.979997352Z [2024-02-23 03:50:00,975: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:50:01.037949268Z [2024-02-23 03:50:01,037: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:01.317845328Z [2024-02-23 03:50:01,317: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T03:50:01.329172240Z [2024-02-23 03:50:01,328: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:01.374625999Z [2024-02-23 03:50:01,374: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:50:01.375657987Z [2024-02-23 03:50:01,375: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:50:01.375836931Z [2024-02-23 03:50:01,375: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:50:01.375915915Z [2024-02-23 03:50:01,375: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T03:50:01.376153969Z [2024-02-23 03:50:01,376: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:50:01.493158066Z [2024-02-23 03:50:01,492: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:01.560616483Z [2024-02-23 03:50:01,560: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6bc7974d-44d0-42d0-b2ea-e422de6724bc] succeeded in 1.1363132610003959s: None 2024-02-23T03:50:02.118071410Z [2024-02-23 03:50:02,117: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cd2b8986-0587-4676-ba04-fbb1d41f9694] succeeded in 1.6804728410006646s: None 2024-02-23T03:50:02.333572516Z [2024-02-23 03:50:02,333: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:50:02.336854193Z [2024-02-23 03:50:02,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:02.342486620Z [2024-02-23 03:50:02,342: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T03:50:02.346901411Z [2024-02-23 03:50:02,346: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:02.359314617Z [2024-02-23 03:50:02,359: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:50:02.360878489Z [2024-02-23 03:50:02,360: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:50:02.361029182Z [2024-02-23 03:50:02,360: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:50:02.361219215Z [2024-02-23 03:50:02,361: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:50:02.361740675Z [2024-02-23 03:50:02,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:50:02.362047890Z [2024-02-23 03:50:02,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:50:02.362454181Z [2024-02-23 03:50:02,362: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:50:02.378654820Z [2024-02-23 03:50:02,378: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:50:02.379853808Z [2024-02-23 03:50:02,379: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:50:02.379889874Z [2024-02-23 03:50:02,379: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:50:02.380073391Z [2024-02-23 03:50:02,379: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:50:02.380146862Z [2024-02-23 03:50:02,380: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T03:50:02.380548916Z [2024-02-23 03:50:02,380: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:50:02.380628536Z [2024-02-23 03:50:02,380: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:50:02.394994398Z [2024-02-23 03:50:02,394: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:50:02.399396646Z [2024-02-23 03:50:02,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:02.434588918Z [2024-02-23 03:50:02,434: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:50:02.437714938Z [2024-02-23 03:50:02,437: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:50:02.437839217Z [2024-02-23 03:50:02,437: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:50:02.438019424Z [2024-02-23 03:50:02,437: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:50:02.438129606Z [2024-02-23 03:50:02,437: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:50:02.438467884Z [2024-02-23 03:50:02,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:50:02.438678140Z [2024-02-23 03:50:02,438: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:50:02.454026473Z [2024-02-23 03:50:02,453: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:02.467307639Z [2024-02-23 03:50:02,466: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:02.534578333Z [2024-02-23 03:50:02,534: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:03.199176357Z [2024-02-23 03:50:03,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60d96156-8b60-4580-b573-ae6a69fc3edc] succeeded in 2.7797881470014545s: None 2024-02-23T03:50:04.058905120Z [2024-02-23 03:50:04,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[992fe7da-40bc-480b-81f1-c9001ea77508] received 2024-02-23T03:50:04.068008598Z [2024-02-23 03:50:04,067: INFO/ForkPoolWorker-15] [992fe7da-40bc-480b-81f1-c9001ea77508] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:50:04.249966303Z [2024-02-23 03:50:04,249: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[43f08dee-919a-4a67-9310-3e2eea714de9] succeeded in 3.8185148750017106s: None 2024-02-23T03:50:04.401807264Z [2024-02-23 03:50:04,401: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cec615d3-a900-448d-82c5-60e925accc00] succeeded in 3.9811781360003806s: None 2024-02-23T03:50:04.440309487Z [2024-02-23 03:50:04,435: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:50:05.801267537Z [2024-02-23 03:50:05,800: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:50:05.804726606Z [2024-02-23 03:50:05,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:05.833380040Z [2024-02-23 03:50:05,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:50:05.835371095Z [2024-02-23 03:50:05,835: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:50:05.835464401Z [2024-02-23 03:50:05,835: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:50:05.835592867Z [2024-02-23 03:50:05,835: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:50:05.835657600Z [2024-02-23 03:50:05,835: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:50:05.835987395Z [2024-02-23 03:50:05,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:50:05.836063461Z [2024-02-23 03:50:05,835: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:50:05.922254232Z [2024-02-23 03:50:05,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:06.591226529Z [2024-02-23 03:50:06,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[992fe7da-40bc-480b-81f1-c9001ea77508] succeeded in 2.5300731570005155s: None 2024-02-23T03:50:06.831882008Z [2024-02-23 03:50:06,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a8e070b-dc49-4b59-865b-22bf0c53bad9] received 2024-02-23T03:50:06.844555131Z [2024-02-23 03:50:06,844: INFO/ForkPoolWorker-15] [3a8e070b-dc49-4b59-865b-22bf0c53bad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:50:07.155188011Z [2024-02-23 03:50:07,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:50:08.433012740Z [2024-02-23 03:50:08,432: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:50:08.436334663Z [2024-02-23 03:50:08,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:08.459246627Z [2024-02-23 03:50:08,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:50:08.460631924Z [2024-02-23 03:50:08,460: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:50:08.460844475Z [2024-02-23 03:50:08,460: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:50:08.461085146Z [2024-02-23 03:50:08,460: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:50:08.461286805Z [2024-02-23 03:50:08,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:50:08.461643597Z [2024-02-23 03:50:08,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:50:08.461831025Z [2024-02-23 03:50:08,461: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:50:08.565320850Z [2024-02-23 03:50:08,564: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:10.123780297Z [2024-02-23 03:50:10,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a8e070b-dc49-4b59-865b-22bf0c53bad9] succeeded in 3.2878894050008967s: None 2024-02-23T03:50:10.331618330Z [2024-02-23 03:50:10,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90f32716-449f-4a55-908c-1677c5575260] received 2024-02-23T03:50:10.340038388Z [2024-02-23 03:50:10,339: INFO/ForkPoolWorker-15] [90f32716-449f-4a55-908c-1677c5575260] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:50:10.702023969Z [2024-02-23 03:50:10,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:50:11.869979257Z [2024-02-23 03:50:11,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:50:11.873471079Z [2024-02-23 03:50:11,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:50:11.897213069Z [2024-02-23 03:50:11,896: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:50:11.898708458Z [2024-02-23 03:50:11,898: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:50:11.898724936Z [2024-02-23 03:50:11,898: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:50:11.899072440Z [2024-02-23 03:50:11,898: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:50:11.899193705Z [2024-02-23 03:50:11,899: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:50:11.899694481Z [2024-02-23 03:50:11,899: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:50:11.899755262Z [2024-02-23 03:50:11,899: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:50:11.984036680Z [2024-02-23 03:50:11,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:50:12.583643734Z [2024-02-23 03:50:12,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90f32716-449f-4a55-908c-1677c5575260] succeeded in 2.2490330319997156s: None 2024-02-23T03:51:00.658935105Z [2024-02-23 03:51:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a42a8b4-e08e-4661-84ac-6daeb1a65841] received 2024-02-23T03:51:00.661645983Z [2024-02-23 03:51:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[484b1006-a1fc-4ec3-bf8c-ab5390b71901] received 2024-02-23T03:51:00.667636895Z [2024-02-23 03:51:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1af982e8-3517-4495-9e4c-c08fb1e0cfb1] received 2024-02-23T03:51:00.668057407Z [2024-02-23 03:51:00,667: INFO/ForkPoolWorker-15] [5a42a8b4-e08e-4661-84ac-6daeb1a65841] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:51:00.669272195Z [2024-02-23 03:51:00,669: INFO/ForkPoolWorker-16] [484b1006-a1fc-4ec3-bf8c-ab5390b71901] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:51:00.677474918Z [2024-02-23 03:51:00,676: INFO/ForkPoolWorker-1] [1af982e8-3517-4495-9e4c-c08fb1e0cfb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:51:00.975851625Z [2024-02-23 03:51:00,971: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:51:00.980722558Z [2024-02-23 03:51:00,977: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:51:01.013564015Z [2024-02-23 03:51:01,009: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:51:01.160719270Z [2024-02-23 03:51:01,160: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:51:01.164806833Z [2024-02-23 03:51:01,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:51:01.186678289Z [2024-02-23 03:51:01,186: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:51:01.188463734Z [2024-02-23 03:51:01,188: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:51:01.188846103Z [2024-02-23 03:51:01,188: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:51:01.189140859Z [2024-02-23 03:51:01,188: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:51:01.189709045Z [2024-02-23 03:51:01,189: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:51:01.330425466Z [2024-02-23 03:51:01,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:51:01.887288228Z [2024-02-23 03:51:01,886: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[484b1006-a1fc-4ec3-bf8c-ab5390b71901] succeeded in 1.2240627000010136s: None 2024-02-23T03:51:02.206070290Z [2024-02-23 03:51:02,205: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:51:02.209367893Z [2024-02-23 03:51:02,208: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:51:02.233708270Z [2024-02-23 03:51:02,233: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:51:02.236581145Z [2024-02-23 03:51:02,236: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:51:02.237028797Z [2024-02-23 03:51:02,236: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:51:02.237550242Z [2024-02-23 03:51:02,237: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:51:02.237856217Z [2024-02-23 03:51:02,237: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:51:02.238543206Z [2024-02-23 03:51:02,238: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:51:02.238855251Z [2024-02-23 03:51:02,238: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:51:02.252833394Z [2024-02-23 03:51:02,252: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:51:02.256447176Z [2024-02-23 03:51:02,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:51:02.277441599Z [2024-02-23 03:51:02,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:51:02.278937802Z [2024-02-23 03:51:02,278: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:51:02.279126840Z [2024-02-23 03:51:02,278: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:51:02.279341802Z [2024-02-23 03:51:02,279: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:51:02.279456558Z [2024-02-23 03:51:02,279: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:51:02.279731941Z [2024-02-23 03:51:02,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:51:02.279953835Z [2024-02-23 03:51:02,279: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:51:02.336020498Z [2024-02-23 03:51:02,335: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:51:02.364556785Z [2024-02-23 03:51:02,364: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:51:04.243094130Z [2024-02-23 03:51:04,242: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a42a8b4-e08e-4661-84ac-6daeb1a65841] succeeded in 3.579142390000925s: None 2024-02-23T03:51:04.653816388Z [2024-02-23 03:51:04,653: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1af982e8-3517-4495-9e4c-c08fb1e0cfb1] succeeded in 3.9843533469993417s: None 2024-02-23T03:52:00.880120264Z [2024-02-23 03:52:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[100ed4ec-7d1c-4b86-95b6-cb860578a422] received 2024-02-23T03:52:00.882980850Z [2024-02-23 03:52:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eb8d226-b846-4931-93e4-d562ba928cc8] received 2024-02-23T03:52:00.885054883Z [2024-02-23 03:52:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[502da5b5-9a00-41e6-b0b6-565c6678c5a6] received 2024-02-23T03:52:00.892039477Z [2024-02-23 03:52:00,891: INFO/ForkPoolWorker-16] [8eb8d226-b846-4931-93e4-d562ba928cc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:52:00.896226779Z [2024-02-23 03:52:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b5e0dd8-bfd7-410b-bbe5-83a3fb4a5618] received 2024-02-23T03:52:00.896319600Z [2024-02-23 03:52:00,895: INFO/ForkPoolWorker-1] [502da5b5-9a00-41e6-b0b6-565c6678c5a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240223035159_050699', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-02-23T03:52:00.898140769Z [2024-02-23 03:52:00,897: INFO/ForkPoolWorker-15] [100ed4ec-7d1c-4b86-95b6-cb860578a422] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:52:00.898316908Z [2024-02-23 03:52:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0be36758-21d2-429e-889a-f4d9cb87f1ed] received 2024-02-23T03:52:00.905739233Z [2024-02-23 03:52:00,905: INFO/ForkPoolWorker-2] [3b5e0dd8-bfd7-410b-bbe5-83a3fb4a5618] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:52:00.918402377Z [2024-02-23 03:52:00,918: INFO/ForkPoolWorker-3] [0be36758-21d2-429e-889a-f4d9cb87f1ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:52:01.227052760Z [2024-02-23 03:52:01,223: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:52:01.277609468Z [2024-02-23 03:52:01,274: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-02-23T03:52:01.293197948Z [2024-02-23 03:52:01,289: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:52:01.410270723Z [2024-02-23 03:52:01,407: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:52:01.454204966Z [2024-02-23 03:52:01,451: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:52:01.634404340Z [2024-02-23 03:52:01,633: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:52:01.638316819Z [2024-02-23 03:52:01,637: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:52:01.673291928Z [2024-02-23 03:52:01,673: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:52:01.674818723Z [2024-02-23 03:52:01,674: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:52:01.675011044Z [2024-02-23 03:52:01,674: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:52:01.675092475Z [2024-02-23 03:52:01,675: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:52:01.675300833Z [2024-02-23 03:52:01,675: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:52:01.753207793Z [2024-02-23 03:52:01,752: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:52:01.788335841Z [2024-02-23 03:52:01,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:52:01.859955623Z [2024-02-23 03:52:01,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:52:02.598957212Z [2024-02-23 03:52:02,598: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3b5e0dd8-bfd7-410b-bbe5-83a3fb4a5618] succeeded in 1.7004414219991304s: None 2024-02-23T03:52:02.728073344Z [2024-02-23 03:52:02,727: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[502da5b5-9a00-41e6-b0b6-565c6678c5a6] succeeded in 1.8412052460007544s: None 2024-02-23T03:52:02.731296002Z [2024-02-23 03:52:02,730: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8eb8d226-b846-4931-93e4-d562ba928cc8] succeeded in 1.8468263790000492s: None 2024-02-23T03:52:02.907066091Z [2024-02-23 03:52:02,906: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T03:52:02.910505059Z [2024-02-23 03:52:02,909: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:52:02.935095107Z [2024-02-23 03:52:02,934: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:52:02.936601565Z [2024-02-23 03:52:02,936: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:52:02.936683845Z [2024-02-23 03:52:02,936: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:52:02.936922696Z [2024-02-23 03:52:02,936: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:52:02.937030975Z [2024-02-23 03:52:02,936: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T03:52:02.937479994Z [2024-02-23 03:52:02,937: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:52:02.937688686Z [2024-02-23 03:52:02,937: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:52:03.035165573Z [2024-02-23 03:52:03,034: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:52:03.070695493Z [2024-02-23 03:52:03,070: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:52:03.073983607Z [2024-02-23 03:52:03,073: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:52:03.104238166Z [2024-02-23 03:52:03,103: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:52:03.105688573Z [2024-02-23 03:52:03,105: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:52:03.105706658Z [2024-02-23 03:52:03,105: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:52:03.105835368Z [2024-02-23 03:52:03,105: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:52:03.105875104Z [2024-02-23 03:52:03,105: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:52:03.106226320Z [2024-02-23 03:52:03,106: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:52:03.106251119Z [2024-02-23 03:52:03,106: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:52:03.212741825Z [2024-02-23 03:52:03,212: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:52:04.861546669Z [2024-02-23 03:52:04,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[100ed4ec-7d1c-4b86-95b6-cb860578a422] succeeded in 3.9762833929999033s: None 2024-02-23T03:52:05.233879470Z [2024-02-23 03:52:05,233: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0be36758-21d2-429e-889a-f4d9cb87f1ed] succeeded in 4.333483953998439s: None 2024-02-23T03:53:01.166292931Z [2024-02-23 03:53:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fae1797d-bdfe-4d58-a2d1-aea7ffc578ff] received 2024-02-23T03:53:01.170868660Z [2024-02-23 03:53:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e4d350d-e62d-4fad-b71a-f41770548349] received 2024-02-23T03:53:01.177520899Z [2024-02-23 03:53:01,177: INFO/ForkPoolWorker-15] [fae1797d-bdfe-4d58-a2d1-aea7ffc578ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:53:01.181684048Z [2024-02-23 03:53:01,181: INFO/ForkPoolWorker-16] [7e4d350d-e62d-4fad-b71a-f41770548349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:53:01.184621168Z [2024-02-23 03:53:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56199a97-6221-4966-8d7d-fc90f610fd1f] received 2024-02-23T03:53:01.201114962Z [2024-02-23 03:53:01,200: INFO/ForkPoolWorker-1] [56199a97-6221-4966-8d7d-fc90f610fd1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:53:01.479619061Z [2024-02-23 03:53:01,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:53:01.583352989Z [2024-02-23 03:53:01,580: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:53:01.597453811Z [2024-02-23 03:53:01,594: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:53:01.638496807Z [2024-02-23 03:53:01,638: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T03:53:01.642411734Z [2024-02-23 03:53:01,641: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:53:01.672740334Z [2024-02-23 03:53:01,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:53:01.677708239Z [2024-02-23 03:53:01,677: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:53:01.678073417Z [2024-02-23 03:53:01,677: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:53:01.678218589Z [2024-02-23 03:53:01,678: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T03:53:01.679475042Z [2024-02-23 03:53:01,679: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:53:01.823061846Z [2024-02-23 03:53:01,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:53:02.476077438Z [2024-02-23 03:53:02,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fae1797d-bdfe-4d58-a2d1-aea7ffc578ff] succeeded in 1.303800138999577s: None 2024-02-23T03:53:02.749222964Z [2024-02-23 03:53:02,748: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:53:02.752984908Z [2024-02-23 03:53:02,752: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:53:02.777608062Z [2024-02-23 03:53:02,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:53:02.779198997Z [2024-02-23 03:53:02,778: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:53:02.779390986Z [2024-02-23 03:53:02,779: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:53:02.779661509Z [2024-02-23 03:53:02,779: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:53:02.779822011Z [2024-02-23 03:53:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:53:02.780240649Z [2024-02-23 03:53:02,780: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:53:02.780425582Z [2024-02-23 03:53:02,780: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:53:02.830099816Z [2024-02-23 03:53:02,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:53:02.833344635Z [2024-02-23 03:53:02,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:53:02.855495463Z [2024-02-23 03:53:02,855: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:53:02.856683949Z [2024-02-23 03:53:02,856: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:53:02.856701502Z [2024-02-23 03:53:02,856: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:53:02.856822073Z [2024-02-23 03:53:02,856: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:53:02.856831637Z [2024-02-23 03:53:02,856: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:53:02.857161234Z [2024-02-23 03:53:02,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:53:02.857174070Z [2024-02-23 03:53:02,857: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:53:02.887810740Z [2024-02-23 03:53:02,887: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:53:02.943551292Z [2024-02-23 03:53:02,943: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:53:05.682063635Z [2024-02-23 03:53:05,681: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56199a97-6221-4966-8d7d-fc90f610fd1f] succeeded in 4.49554453699966s: None 2024-02-23T03:53:06.299718229Z [2024-02-23 03:53:06,299: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e4d350d-e62d-4fad-b71a-f41770548349] succeeded in 5.127547484000388s: None 2024-02-23T03:54:00.326946292Z [2024-02-23 03:54:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7683019-50bb-49d7-99d6-0998b4b9b69d] received 2024-02-23T03:54:00.332094261Z [2024-02-23 03:54:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3380385e-4fbc-4093-bcb5-8419572df628] received 2024-02-23T03:54:00.342768692Z [2024-02-23 03:54:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a9cf12-aef8-4cea-9206-d3f91378d9d9] received 2024-02-23T03:54:00.345010793Z [2024-02-23 03:54:00,344: INFO/ForkPoolWorker-15] [f7683019-50bb-49d7-99d6-0998b4b9b69d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:54:00.347223626Z [2024-02-23 03:54:00,347: INFO/ForkPoolWorker-16] [3380385e-4fbc-4093-bcb5-8419572df628] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:54:00.353881448Z [2024-02-23 03:54:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2a3d5db-5acc-4930-8c76-962c6f26a951] received 2024-02-23T03:54:00.359651273Z [2024-02-23 03:54:00,359: INFO/ForkPoolWorker-1] [a6a9cf12-aef8-4cea-9206-d3f91378d9d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:54:00.360132747Z [2024-02-23 03:54:00,359: INFO/ForkPoolWorker-2] [d2a3d5db-5acc-4930-8c76-962c6f26a951] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:54:00.664777213Z [2024-02-23 03:54:00,661: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:54:00.673486113Z [2024-02-23 03:54:00,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:54:00.677431841Z [2024-02-23 03:54:00,672: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:54:00.680517027Z [2024-02-23 03:54:00,676: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:54:00.866755909Z [2024-02-23 03:54:00,866: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:54:00.871964151Z [2024-02-23 03:54:00,871: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:54:00.916837865Z [2024-02-23 03:54:00,916: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:54:00.918980704Z [2024-02-23 03:54:00,918: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:54:00.919414571Z [2024-02-23 03:54:00,919: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:54:00.919926581Z [2024-02-23 03:54:00,919: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:54:00.920617998Z [2024-02-23 03:54:00,920: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:54:00.932459264Z [2024-02-23 03:54:00,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:54:01.035934686Z [2024-02-23 03:54:01,035: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:54:01.590277650Z [2024-02-23 03:54:01,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7683019-50bb-49d7-99d6-0998b4b9b69d] succeeded in 1.252258475000417s: None 2024-02-23T03:54:01.622044044Z [2024-02-23 03:54:01,621: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d2a3d5db-5acc-4930-8c76-962c6f26a951] succeeded in 1.2660837059993355s: None 2024-02-23T03:54:01.990165648Z [2024-02-23 03:54:01,989: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:54:01.993625692Z [2024-02-23 03:54:01,993: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:54:02.015977420Z [2024-02-23 03:54:02,015: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:54:02.017237408Z [2024-02-23 03:54:02,016: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:54:02.017250998Z [2024-02-23 03:54:02,017: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:54:02.017383680Z [2024-02-23 03:54:02,017: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:54:02.017423441Z [2024-02-23 03:54:02,017: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:54:02.017642425Z [2024-02-23 03:54:02,017: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:54:02.017665848Z [2024-02-23 03:54:02,017: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:54:02.023169450Z [2024-02-23 03:54:02,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:54:02.026559610Z [2024-02-23 03:54:02,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:54:02.061914004Z [2024-02-23 03:54:02,061: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:54:02.063984741Z [2024-02-23 03:54:02,063: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:54:02.064221135Z [2024-02-23 03:54:02,063: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:54:02.064568790Z [2024-02-23 03:54:02,064: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:54:02.064802635Z [2024-02-23 03:54:02,064: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:54:02.071711957Z [2024-02-23 03:54:02,071: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:54:02.071909117Z [2024-02-23 03:54:02,071: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:54:02.106434009Z [2024-02-23 03:54:02,106: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:54:02.188337580Z [2024-02-23 03:54:02,188: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:54:03.583523426Z [2024-02-23 03:54:03,582: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a6a9cf12-aef8-4cea-9206-d3f91378d9d9] succeeded in 3.238849401999687s: None 2024-02-23T03:54:04.104735046Z [2024-02-23 03:54:04,104: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3380385e-4fbc-4093-bcb5-8419572df628] succeeded in 3.7688669599992863s: None 2024-02-23T03:55:01.268489684Z [2024-02-23 03:55:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9298df12-ae46-4c5a-9c09-e3900353f1b9] received 2024-02-23T03:55:01.273347155Z [2024-02-23 03:55:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abdc2526-759f-4b77-95dd-e24d56f7b07d] received 2024-02-23T03:55:01.278115608Z [2024-02-23 03:55:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e51abd0-21b8-4d5b-8bb7-bf66459e63ab] received 2024-02-23T03:55:01.278470886Z [2024-02-23 03:55:01,278: INFO/ForkPoolWorker-15] [9298df12-ae46-4c5a-9c09-e3900353f1b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:55:01.280495538Z [2024-02-23 03:55:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9347fd04-f114-422d-8bf1-43814c003e8e] received 2024-02-23T03:55:01.286818575Z [2024-02-23 03:55:01,286: INFO/ForkPoolWorker-1] [5e51abd0-21b8-4d5b-8bb7-bf66459e63ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:55:01.299414812Z [2024-02-23 03:55:01,298: INFO/ForkPoolWorker-2] [9347fd04-f114-422d-8bf1-43814c003e8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:55:01.306269132Z [2024-02-23 03:55:01,305: INFO/ForkPoolWorker-16] [abdc2526-759f-4b77-95dd-e24d56f7b07d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:55:01.548093039Z [2024-02-23 03:55:01,545: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:55:01.617855710Z [2024-02-23 03:55:01,614: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:55:01.715148996Z [2024-02-23 03:55:01,710: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:55:01.766100580Z [2024-02-23 03:55:01,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:55:01.911037752Z [2024-02-23 03:55:01,910: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:55:01.915976477Z [2024-02-23 03:55:01,915: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:01.951592920Z [2024-02-23 03:55:01,951: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:55:01.953032582Z [2024-02-23 03:55:01,952: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:55:01.953143877Z [2024-02-23 03:55:01,952: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:55:01.953240489Z [2024-02-23 03:55:01,953: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:55:01.953429544Z [2024-02-23 03:55:01,953: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:55:02.049611769Z [2024-02-23 03:55:02,049: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:02.778618747Z [2024-02-23 03:55:02,778: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9347fd04-f114-422d-8bf1-43814c003e8e] succeeded in 1.4960298169971793s: None 2024-02-23T03:55:02.849204952Z [2024-02-23 03:55:02,848: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:55:02.852806976Z [2024-02-23 03:55:02,852: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:02.875071388Z [2024-02-23 03:55:02,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:55:02.876813129Z [2024-02-23 03:55:02,876: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:55:02.876827020Z [2024-02-23 03:55:02,876: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:55:02.877052778Z [2024-02-23 03:55:02,876: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:55:02.877083904Z [2024-02-23 03:55:02,876: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:55:02.877453836Z [2024-02-23 03:55:02,877: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:55:02.877470914Z [2024-02-23 03:55:02,877: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:55:02.959882179Z [2024-02-23 03:55:02,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:02.989256771Z [2024-02-23 03:55:02,988: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:55:02.992988356Z [2024-02-23 03:55:02,992: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:03.015364614Z [2024-02-23 03:55:03,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:55:03.016694998Z [2024-02-23 03:55:03,016: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:55:03.016713587Z [2024-02-23 03:55:03,016: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:55:03.016911282Z [2024-02-23 03:55:03,016: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:55:03.016922262Z [2024-02-23 03:55:03,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:55:03.017252548Z [2024-02-23 03:55:03,017: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:55:03.017289523Z [2024-02-23 03:55:03,017: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:55:03.096847357Z [2024-02-23 03:55:03,096: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:03.371383446Z [2024-02-23 03:55:03,371: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:55:03.375043163Z [2024-02-23 03:55:03,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:03.405107406Z [2024-02-23 03:55:03,404: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:55:03.406931965Z [2024-02-23 03:55:03,406: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:55:03.407102816Z [2024-02-23 03:55:03,406: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:55:03.407394765Z [2024-02-23 03:55:03,407: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:55:03.407520434Z [2024-02-23 03:55:03,407: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:55:03.407982563Z [2024-02-23 03:55:03,407: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:55:03.408114821Z [2024-02-23 03:55:03,407: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:55:03.493439738Z [2024-02-23 03:55:03,492: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:03.590490119Z [2024-02-23 03:55:03,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9298df12-ae46-4c5a-9c09-e3900353f1b9] succeeded in 2.319011250998301s: None 2024-02-23T03:55:04.573002983Z [2024-02-23 03:55:04,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09691cde-0cb9-425c-80fd-d9046e9cf0ec] received 2024-02-23T03:55:04.581161506Z [2024-02-23 03:55:04,580: INFO/ForkPoolWorker-15] [09691cde-0cb9-425c-80fd-d9046e9cf0ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:55:04.926896650Z [2024-02-23 03:55:04,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:55:05.150713872Z [2024-02-23 03:55:05,150: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e51abd0-21b8-4d5b-8bb7-bf66459e63ab] succeeded in 3.8707357950006553s: None 2024-02-23T03:55:05.230880818Z [2024-02-23 03:55:05,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[abdc2526-759f-4b77-95dd-e24d56f7b07d] succeeded in 3.954389488000743s: None 2024-02-23T03:55:06.156838790Z [2024-02-23 03:55:06,156: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:55:06.160031776Z [2024-02-23 03:55:06,159: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:06.187049198Z [2024-02-23 03:55:06,186: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:55:06.188663575Z [2024-02-23 03:55:06,188: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:55:06.188857283Z [2024-02-23 03:55:06,188: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:55:06.189060759Z [2024-02-23 03:55:06,188: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:55:06.189189561Z [2024-02-23 03:55:06,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:55:06.189857143Z [2024-02-23 03:55:06,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:55:06.189867729Z [2024-02-23 03:55:06,189: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:55:06.296947541Z [2024-02-23 03:55:06,296: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:06.969396001Z [2024-02-23 03:55:06,968: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09691cde-0cb9-425c-80fd-d9046e9cf0ec] succeeded in 2.3939259809994837s: None 2024-02-23T03:55:07.019860344Z [2024-02-23 03:55:07,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca6d2dc3-77a1-4883-87d2-43690c0a7859] received 2024-02-23T03:55:07.027974736Z [2024-02-23 03:55:07,027: INFO/ForkPoolWorker-15] [ca6d2dc3-77a1-4883-87d2-43690c0a7859] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T03:55:07.342546426Z [2024-02-23 03:55:07,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:55:08.521744703Z [2024-02-23 03:55:08,521: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:55:08.525125165Z [2024-02-23 03:55:08,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:08.545727472Z [2024-02-23 03:55:08,545: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:55:08.547485120Z [2024-02-23 03:55:08,547: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:55:08.547613613Z [2024-02-23 03:55:08,547: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:55:08.547794314Z [2024-02-23 03:55:08,547: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:55:08.547895420Z [2024-02-23 03:55:08,547: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:55:08.548185305Z [2024-02-23 03:55:08,548: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:55:08.548642754Z [2024-02-23 03:55:08,548: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:55:08.655033115Z [2024-02-23 03:55:08,654: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:10.577240552Z [2024-02-23 03:55:10,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca6d2dc3-77a1-4883-87d2-43690c0a7859] succeeded in 3.5552677170016977s: None 2024-02-23T03:55:11.352085806Z [2024-02-23 03:55:11,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59d9424d-a5b0-4fe7-8f1a-f482be2aa6e8] received 2024-02-23T03:55:11.363328573Z [2024-02-23 03:55:11,362: INFO/ForkPoolWorker-15] [59d9424d-a5b0-4fe7-8f1a-f482be2aa6e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T03:55:11.662694640Z [2024-02-23 03:55:11,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T03:55:12.785542852Z [2024-02-23 03:55:12,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:55:12.788786285Z [2024-02-23 03:55:12,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:55:12.820046597Z [2024-02-23 03:55:12,819: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:55:12.821286389Z [2024-02-23 03:55:12,821: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:55:12.821388632Z [2024-02-23 03:55:12,821: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:55:12.821556944Z [2024-02-23 03:55:12,821: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:55:12.821633227Z [2024-02-23 03:55:12,821: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:55:12.822019497Z [2024-02-23 03:55:12,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T03:55:12.822216501Z [2024-02-23 03:55:12,822: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:55:12.908484474Z [2024-02-23 03:55:12,908: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:55:13.531960803Z [2024-02-23 03:55:13,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59d9424d-a5b0-4fe7-8f1a-f482be2aa6e8] succeeded in 2.175595198001247s: None 2024-02-23T03:56:00.714678905Z [2024-02-23 03:56:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fc5bfbe-70e5-4d15-a5c8-60a097946a92] received 2024-02-23T03:56:00.716588328Z [2024-02-23 03:56:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ab5104d-b0b3-4c5c-ba4d-519021bc1d1f] received 2024-02-23T03:56:00.724061566Z [2024-02-23 03:56:00,723: INFO/ForkPoolWorker-15] [7fc5bfbe-70e5-4d15-a5c8-60a097946a92] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:56:00.726342330Z [2024-02-23 03:56:00,726: INFO/ForkPoolWorker-16] [7ab5104d-b0b3-4c5c-ba4d-519021bc1d1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:56:00.734009119Z [2024-02-23 03:56:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eda1fc76-2ff2-4135-8f9c-0e75a6bf0c0b] received 2024-02-23T03:56:00.739223163Z [2024-02-23 03:56:00,738: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d72303b-13a1-4e2e-b3c0-950f9a727770] received 2024-02-23T03:56:00.753844863Z [2024-02-23 03:56:00,753: INFO/ForkPoolWorker-2] [2d72303b-13a1-4e2e-b3c0-950f9a727770] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:56:00.756853885Z [2024-02-23 03:56:00,755: INFO/ForkPoolWorker-1] [eda1fc76-2ff2-4135-8f9c-0e75a6bf0c0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:56:01.096535007Z [2024-02-23 03:56:01,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:56:01.267046154Z [2024-02-23 03:56:01,263: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:56:01.267419927Z [2024-02-23 03:56:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:56:01.311911801Z [2024-02-23 03:56:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:56:01.655944655Z [2024-02-23 03:56:01,655: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:56:01.689117574Z [2024-02-23 03:56:01,688: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:56:01.693488897Z [2024-02-23 03:56:01,693: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:56:01.733244239Z [2024-02-23 03:56:01,732: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:56:01.739834127Z [2024-02-23 03:56:01,739: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:56:01.740074244Z [2024-02-23 03:56:01,739: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:56:01.740239626Z [2024-02-23 03:56:01,740: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:56:01.740569855Z [2024-02-23 03:56:01,740: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:56:01.949422264Z [2024-02-23 03:56:01,949: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:56:02.395128070Z [2024-02-23 03:56:02,394: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fc5bfbe-70e5-4d15-a5c8-60a097946a92] succeeded in 1.677543614001479s: None 2024-02-23T03:56:02.828151700Z [2024-02-23 03:56:02,827: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d72303b-13a1-4e2e-b3c0-950f9a727770] succeeded in 2.08652642800007s: None 2024-02-23T03:56:03.027589817Z [2024-02-23 03:56:03,027: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:56:03.031071154Z [2024-02-23 03:56:03,030: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:56:03.066694199Z [2024-02-23 03:56:03,066: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:56:03.068988898Z [2024-02-23 03:56:03,068: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:56:03.069250651Z [2024-02-23 03:56:03,069: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:56:03.070359785Z [2024-02-23 03:56:03,070: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:56:03.070493931Z [2024-02-23 03:56:03,070: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:56:03.070872964Z [2024-02-23 03:56:03,070: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:56:03.074074708Z [2024-02-23 03:56:03,073: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:56:03.192898749Z [2024-02-23 03:56:03,192: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:56:03.269808013Z [2024-02-23 03:56:03,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:56:03.273201803Z [2024-02-23 03:56:03,272: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:56:03.318007304Z [2024-02-23 03:56:03,317: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:56:03.320859318Z [2024-02-23 03:56:03,320: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:56:03.321065145Z [2024-02-23 03:56:03,320: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:56:03.321383919Z [2024-02-23 03:56:03,321: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:56:03.321561987Z [2024-02-23 03:56:03,321: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:56:03.321967589Z [2024-02-23 03:56:03,321: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:56:03.322168990Z [2024-02-23 03:56:03,321: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:56:03.436934472Z [2024-02-23 03:56:03,436: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:56:06.580946708Z [2024-02-23 03:56:06,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eda1fc76-2ff2-4135-8f9c-0e75a6bf0c0b] succeeded in 5.840584739999031s: None 2024-02-23T03:56:08.665651267Z [2024-02-23 03:56:08,665: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ab5104d-b0b3-4c5c-ba4d-519021bc1d1f] succeeded in 7.947289145999093s: None 2024-02-23T03:57:01.313948336Z [2024-02-23 03:57:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfe37457-d31f-43eb-9fc7-bd578af3d124] received 2024-02-23T03:57:01.326175441Z [2024-02-23 03:57:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76517ea0-8ab4-4a1e-a241-c73477cd8146] received 2024-02-23T03:57:01.327096407Z [2024-02-23 03:57:01,326: INFO/ForkPoolWorker-15] [cfe37457-d31f-43eb-9fc7-bd578af3d124] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:57:01.333615652Z [2024-02-23 03:57:01,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f22108d-b683-4eba-a6b1-3401f330caca] received 2024-02-23T03:57:01.339323337Z [2024-02-23 03:57:01,339: INFO/ForkPoolWorker-16] [76517ea0-8ab4-4a1e-a241-c73477cd8146] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:57:01.351001281Z [2024-02-23 03:57:01,350: INFO/ForkPoolWorker-1] [2f22108d-b683-4eba-a6b1-3401f330caca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:57:01.645182885Z [2024-02-23 03:57:01,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:57:01.672731066Z [2024-02-23 03:57:01,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:57:01.682142965Z [2024-02-23 03:57:01,679: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:57:01.866961082Z [2024-02-23 03:57:01,866: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T03:57:01.871031492Z [2024-02-23 03:57:01,870: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:57:01.908528125Z [2024-02-23 03:57:01,908: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:57:01.911839571Z [2024-02-23 03:57:01,911: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:57:01.911941589Z [2024-02-23 03:57:01,911: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:57:01.911996347Z [2024-02-23 03:57:01,911: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T03:57:01.912264129Z [2024-02-23 03:57:01,912: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:57:02.033625680Z [2024-02-23 03:57:02,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:57:02.696597640Z [2024-02-23 03:57:02,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f22108d-b683-4eba-a6b1-3401f330caca] succeeded in 1.3605761229991913s: None 2024-02-23T03:57:02.823540141Z [2024-02-23 03:57:02,823: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:57:02.826774009Z [2024-02-23 03:57:02,826: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:57:02.846811014Z [2024-02-23 03:57:02,846: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:57:02.848087385Z [2024-02-23 03:57:02,847: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:57:02.848102471Z [2024-02-23 03:57:02,847: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:57:02.848270062Z [2024-02-23 03:57:02,848: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:57:02.848286116Z [2024-02-23 03:57:02,848: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:57:02.848559082Z [2024-02-23 03:57:02,848: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:57:02.848573655Z [2024-02-23 03:57:02,848: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:57:02.867398770Z [2024-02-23 03:57:02,866: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:57:02.871055335Z [2024-02-23 03:57:02,870: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:57:02.893138187Z [2024-02-23 03:57:02,892: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:57:02.894507215Z [2024-02-23 03:57:02,894: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:57:02.894526884Z [2024-02-23 03:57:02,894: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:57:02.894760978Z [2024-02-23 03:57:02,894: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:57:02.894784252Z [2024-02-23 03:57:02,894: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:57:02.895300339Z [2024-02-23 03:57:02,895: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:57:02.895421169Z [2024-02-23 03:57:02,895: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:57:02.934001558Z [2024-02-23 03:57:02,933: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:57:02.986796253Z [2024-02-23 03:57:02,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:57:05.968221289Z [2024-02-23 03:57:05,967: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[76517ea0-8ab4-4a1e-a241-c73477cd8146] succeeded in 4.639456466000411s: None 2024-02-23T03:57:06.736847114Z [2024-02-23 03:57:06,736: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfe37457-d31f-43eb-9fc7-bd578af3d124] succeeded in 5.419989609999902s: None 2024-02-23T03:58:01.116923390Z [2024-02-23 03:58:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88f1eb1f-26ca-455d-81a1-2408047165b1] received 2024-02-23T03:58:01.120064084Z [2024-02-23 03:58:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7666368-18ca-44ac-a0ad-2d377b01a78a] received 2024-02-23T03:58:01.121545774Z [2024-02-23 03:58:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5666b63-74fc-4fea-8b77-a8b318142d5f] received 2024-02-23T03:58:01.123263339Z [2024-02-23 03:58:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5c7786b-c01e-4300-8fc0-dbf5fe3e9302] received 2024-02-23T03:58:01.125236462Z [2024-02-23 03:58:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a1fc168-7fab-4371-8fbd-4a8f52369083] received 2024-02-23T03:58:01.125573586Z [2024-02-23 03:58:01,123: INFO/ForkPoolWorker-15] [88f1eb1f-26ca-455d-81a1-2408047165b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T03:58:01.135023700Z [2024-02-23 03:58:01,134: INFO/ForkPoolWorker-3] [7a1fc168-7fab-4371-8fbd-4a8f52369083] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:58:01.135367621Z [2024-02-23 03:58:01,135: INFO/ForkPoolWorker-16] [f7666368-18ca-44ac-a0ad-2d377b01a78a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:58:01.135880467Z [2024-02-23 03:58:01,135: INFO/ForkPoolWorker-1] [f5666b63-74fc-4fea-8b77-a8b318142d5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240223035759_012028', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-02-23T03:58:01.139394799Z [2024-02-23 03:58:01,139: INFO/ForkPoolWorker-2] [d5c7786b-c01e-4300-8fc0-dbf5fe3e9302] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:58:01.525440309Z [2024-02-23 03:58:01,521: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:58:01.540232155Z [2024-02-23 03:58:01,531: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:58:01.550476240Z [2024-02-23 03:58:01,547: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-02-23T03:58:01.565101931Z [2024-02-23 03:58:01,562: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:58:01.798503469Z [2024-02-23 03:58:01,792: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T03:58:01.983045625Z [2024-02-23 03:58:01,982: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T03:58:01.988674626Z [2024-02-23 03:58:01,988: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:58:02.057730343Z [2024-02-23 03:58:02,057: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T03:58:02.060118915Z [2024-02-23 03:58:02,059: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:58:02.060194084Z [2024-02-23 03:58:02,060: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:58:02.060269205Z [2024-02-23 03:58:02,060: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T03:58:02.060538725Z [2024-02-23 03:58:02,060: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:58:02.102481059Z [2024-02-23 03:58:02,102: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:58:02.102660321Z [2024-02-23 03:58:02,102: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:58:02.221813210Z [2024-02-23 03:58:02,221: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:58:02.858416668Z [2024-02-23 03:58:02,857: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88f1eb1f-26ca-455d-81a1-2408047165b1] succeeded in 1.740133708997746s: None 2024-02-23T03:58:02.909610499Z [2024-02-23 03:58:02,909: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5666b63-74fc-4fea-8b77-a8b318142d5f] succeeded in 1.7849265909972019s: None 2024-02-23T03:58:02.950784119Z [2024-02-23 03:58:02,950: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5c7786b-c01e-4300-8fc0-dbf5fe3e9302] succeeded in 1.8261583830026211s: None 2024-02-23T03:58:03.045740290Z [2024-02-23 03:58:03,045: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T03:58:03.050344705Z [2024-02-23 03:58:03,049: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:58:03.065781366Z [2024-02-23 03:58:03,065: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T03:58:03.069547537Z [2024-02-23 03:58:03,068: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:58:03.075216670Z [2024-02-23 03:58:03,074: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:58:03.077220463Z [2024-02-23 03:58:03,076: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:58:03.077270375Z [2024-02-23 03:58:03,077: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:58:03.077479829Z [2024-02-23 03:58:03,077: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:58:03.077682510Z [2024-02-23 03:58:03,077: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T03:58:03.078237081Z [2024-02-23 03:58:03,077: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:58:03.078730628Z [2024-02-23 03:58:03,078: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:58:03.099530403Z [2024-02-23 03:58:03,099: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T03:58:03.100830943Z [2024-02-23 03:58:03,100: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:58:03.101011518Z [2024-02-23 03:58:03,100: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:58:03.101204530Z [2024-02-23 03:58:03,101: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:58:03.101346642Z [2024-02-23 03:58:03,101: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T03:58:03.101770269Z [2024-02-23 03:58:03,101: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:58:03.101915703Z [2024-02-23 03:58:03,101: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:58:03.198777642Z [2024-02-23 03:58:03,198: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:58:03.205687610Z [2024-02-23 03:58:03,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:58:05.168185259Z [2024-02-23 03:58:05,167: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7666368-18ca-44ac-a0ad-2d377b01a78a] succeeded in 4.040471738000633s: None 2024-02-23T03:58:05.368532332Z [2024-02-23 03:58:05,367: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7a1fc168-7fab-4371-8fbd-4a8f52369083] succeeded in 4.241283855000802s: None 2024-02-23T03:59:00.952506105Z [2024-02-23 03:59:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05d58f43-efaa-4b4c-9ad4-3652c10b4327] received 2024-02-23T03:59:00.958387566Z [2024-02-23 03:59:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9f650ff-2f0f-4bc7-90b8-3af469dbf52c] received 2024-02-23T03:59:00.959444709Z [2024-02-23 03:59:00,959: INFO/ForkPoolWorker-15] [05d58f43-efaa-4b4c-9ad4-3652c10b4327] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T03:59:00.964484032Z [2024-02-23 03:59:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[446d4c47-23f9-42b7-b65f-162823e2e92d] received 2024-02-23T03:59:00.972164345Z [2024-02-23 03:59:00,971: INFO/ForkPoolWorker-1] [446d4c47-23f9-42b7-b65f-162823e2e92d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T03:59:00.978641111Z [2024-02-23 03:59:00,978: INFO/ForkPoolWorker-16] [c9f650ff-2f0f-4bc7-90b8-3af469dbf52c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T03:59:01.280428504Z [2024-02-23 03:59:01,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T03:59:01.300122122Z [2024-02-23 03:59:01,297: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T03:59:01.384430451Z [2024-02-23 03:59:01,380: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T03:59:01.467283931Z [2024-02-23 03:59:01,466: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T03:59:01.471219541Z [2024-02-23 03:59:01,470: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:59:01.493958902Z [2024-02-23 03:59:01,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T03:59:01.495327320Z [2024-02-23 03:59:01,495: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T03:59:01.495535844Z [2024-02-23 03:59:01,495: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T03:59:01.495739780Z [2024-02-23 03:59:01,495: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T03:59:01.496111974Z [2024-02-23 03:59:01,495: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T03:59:01.602122703Z [2024-02-23 03:59:01,601: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:59:02.287244933Z [2024-02-23 03:59:02,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9f650ff-2f0f-4bc7-90b8-3af469dbf52c] succeeded in 1.3254753729997901s: None 2024-02-23T03:59:02.470045472Z [2024-02-23 03:59:02,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T03:59:02.473338936Z [2024-02-23 03:59:02,472: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:59:02.495216017Z [2024-02-23 03:59:02,494: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T03:59:02.496706733Z [2024-02-23 03:59:02,496: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:59:02.496820159Z [2024-02-23 03:59:02,496: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:59:02.497023847Z [2024-02-23 03:59:02,496: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:59:02.497148939Z [2024-02-23 03:59:02,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T03:59:02.497442109Z [2024-02-23 03:59:02,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T03:59:02.497583898Z [2024-02-23 03:59:02,497: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:59:02.609079466Z [2024-02-23 03:59:02,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:59:02.703660792Z [2024-02-23 03:59:02,703: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T03:59:02.707053276Z [2024-02-23 03:59:02,706: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T03:59:02.732911429Z [2024-02-23 03:59:02,732: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T03:59:02.734430844Z [2024-02-23 03:59:02,734: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T03:59:02.734600691Z [2024-02-23 03:59:02,734: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T03:59:02.734856716Z [2024-02-23 03:59:02,734: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T03:59:02.734999487Z [2024-02-23 03:59:02,734: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T03:59:02.735346549Z [2024-02-23 03:59:02,735: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T03:59:02.735999349Z [2024-02-23 03:59:02,735: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T03:59:02.826662058Z [2024-02-23 03:59:02,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T03:59:04.477640034Z [2024-02-23 03:59:04,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05d58f43-efaa-4b4c-9ad4-3652c10b4327] succeeded in 3.523457803999918s: None 2024-02-23T03:59:04.843013522Z [2024-02-23 03:59:04,842: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[446d4c47-23f9-42b7-b65f-162823e2e92d] succeeded in 3.876988446998439s: None 2024-02-23T04:00:00.298129909Z [2024-02-23 04:00:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a790cee-80ea-4cc8-aaf6-64b8618ff540] received 2024-02-23T04:00:00.301278481Z [2024-02-23 04:00:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10c71c09-98a1-4082-8e53-f7b0a150389b] received 2024-02-23T04:00:00.304377652Z [2024-02-23 04:00:00,304: INFO/ForkPoolWorker-15] [2a790cee-80ea-4cc8-aaf6-64b8618ff540] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:00:00.310500029Z [2024-02-23 04:00:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7acdfd9a-2487-4d0b-964d-211c02089743] received 2024-02-23T04:00:00.313212293Z [2024-02-23 04:00:00,312: INFO/ForkPoolWorker-16] [10c71c09-98a1-4082-8e53-f7b0a150389b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:00:00.339683767Z [2024-02-23 04:00:00,339: INFO/ForkPoolWorker-1] [7acdfd9a-2487-4d0b-964d-211c02089743] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:00:00.508495736Z [2024-02-23 04:00:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d28b397-ef7d-44d5-a962-f5ec1e288b37] received 2024-02-23T04:00:00.517364629Z [2024-02-23 04:00:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[245ddfc2-562d-4b36-adc1-8d166f06fb30] received 2024-02-23T04:00:00.518647693Z [2024-02-23 04:00:00,518: INFO/ForkPoolWorker-2] [7d28b397-ef7d-44d5-a962-f5ec1e288b37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:00:00.524656377Z [2024-02-23 04:00:00,524: INFO/ForkPoolWorker-3] [245ddfc2-562d-4b36-adc1-8d166f06fb30] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:00:00.918810345Z [2024-02-23 04:00:00,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:00:00.953883283Z [2024-02-23 04:00:00,948: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:00:01.104633905Z [2024-02-23 04:00:01,100: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:00:01.183892342Z [2024-02-23 04:00:01,175: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:00:01.268089539Z [2024-02-23 04:00:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[677c2ba4-3c76-4fff-a45a-691874758e1a] received 2024-02-23T04:00:01.281613249Z [2024-02-23 04:00:01,281: INFO/ForkPoolWorker-4] [677c2ba4-3c76-4fff-a45a-691874758e1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240223035959_193370', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-02-23T04:00:01.338685880Z [2024-02-23 04:00:01,338: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:00:01.343295623Z [2024-02-23 04:00:01,342: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:01.370113504Z [2024-02-23 04:00:01,369: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:00:01.371356341Z [2024-02-23 04:00:01,371: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:00:01.371523534Z [2024-02-23 04:00:01,371: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:00:01.371632992Z [2024-02-23 04:00:01,371: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:00:01.371882769Z [2024-02-23 04:00:01,371: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:00:01.501232614Z [2024-02-23 04:00:01,473: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:00:01.513136198Z [2024-02-23 04:00:01,512: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:01.692413931Z [2024-02-23 04:00:01,687: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-02-23T04:00:01.839645456Z [2024-02-23 04:00:01,839: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:02.228137088Z [2024-02-23 04:00:02,227: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:02.396278303Z [2024-02-23 04:00:02,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7acdfd9a-2487-4d0b-964d-211c02089743] succeeded in 2.082847044999653s: None 2024-02-23T04:00:02.538512138Z [2024-02-23 04:00:02,537: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[245ddfc2-562d-4b36-adc1-8d166f06fb30] succeeded in 2.019545990999177s: None 2024-02-23T04:00:03.000900130Z [2024-02-23 04:00:03,000: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[677c2ba4-3c76-4fff-a45a-691874758e1a] succeeded in 1.730725135999819s: None 2024-02-23T04:00:03.026978126Z [2024-02-23 04:00:03,026: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:00:03.030742203Z [2024-02-23 04:00:03,030: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:03.053543856Z [2024-02-23 04:00:03,053: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:00:03.055477867Z [2024-02-23 04:00:03,055: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:00:03.055570000Z [2024-02-23 04:00:03,055: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:00:03.055788908Z [2024-02-23 04:00:03,055: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:00:03.055904890Z [2024-02-23 04:00:03,055: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:00:03.056514942Z [2024-02-23 04:00:03,056: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:00:03.056788552Z [2024-02-23 04:00:03,056: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:00:03.145848453Z [2024-02-23 04:00:03,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:00:03.149213501Z [2024-02-23 04:00:03,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:03.157329334Z [2024-02-23 04:00:03,156: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:03.176006431Z [2024-02-23 04:00:03,175: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:00:03.178691342Z [2024-02-23 04:00:03,178: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:00:03.178735048Z [2024-02-23 04:00:03,178: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:00:03.178966829Z [2024-02-23 04:00:03,178: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:00:03.178992620Z [2024-02-23 04:00:03,178: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:00:03.179387897Z [2024-02-23 04:00:03,179: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:00:03.179441307Z [2024-02-23 04:00:03,179: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:00:03.285422473Z [2024-02-23 04:00:03,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:03.743705127Z [2024-02-23 04:00:03,742: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:00:03.746785976Z [2024-02-23 04:00:03,746: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:03.769232004Z [2024-02-23 04:00:03,768: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:00:03.771966476Z [2024-02-23 04:00:03,770: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:00:03.772207490Z [2024-02-23 04:00:03,771: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:00:03.772381369Z [2024-02-23 04:00:03,772: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:00:03.772469678Z [2024-02-23 04:00:03,772: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:00:03.772770381Z [2024-02-23 04:00:03,772: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:00:03.772879481Z [2024-02-23 04:00:03,772: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:00:03.889582605Z [2024-02-23 04:00:03,888: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7d28b397-ef7d-44d5-a962-f5ec1e288b37] succeeded in 3.3792071729985764s: None 2024-02-23T04:00:03.890044087Z [2024-02-23 04:00:03,889: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:04.676446750Z [2024-02-23 04:00:04,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a304706c-6376-4d01-a19a-84527a9ab161] received 2024-02-23T04:00:04.690508463Z [2024-02-23 04:00:04,690: INFO/ForkPoolWorker-1] [a304706c-6376-4d01-a19a-84527a9ab161] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:00:05.052703459Z [2024-02-23 04:00:05,049: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:00:05.943715671Z [2024-02-23 04:00:05,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10c71c09-98a1-4082-8e53-f7b0a150389b] succeeded in 5.640060541001731s: None 2024-02-23T04:00:05.961220858Z [2024-02-23 04:00:05,960: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a790cee-80ea-4cc8-aaf6-64b8618ff540] succeeded in 5.661474422002357s: None 2024-02-23T04:00:06.399827995Z [2024-02-23 04:00:06,399: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:00:06.403392074Z [2024-02-23 04:00:06,402: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:06.432058867Z [2024-02-23 04:00:06,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:00:06.433688254Z [2024-02-23 04:00:06,433: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:00:06.433863776Z [2024-02-23 04:00:06,433: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:00:06.434136651Z [2024-02-23 04:00:06,433: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:00:06.434211276Z [2024-02-23 04:00:06,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:00:06.435060041Z [2024-02-23 04:00:06,434: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:00:06.435076957Z [2024-02-23 04:00:06,434: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:00:06.519468208Z [2024-02-23 04:00:06,519: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:07.172467330Z [2024-02-23 04:00:07,171: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a304706c-6376-4d01-a19a-84527a9ab161] succeeded in 2.4937216809994425s: None 2024-02-23T04:00:07.174406519Z [2024-02-23 04:00:07,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de90db45-8bfb-43b3-8e65-ba7005cef652] received 2024-02-23T04:00:07.181821475Z [2024-02-23 04:00:07,181: INFO/ForkPoolWorker-15] [de90db45-8bfb-43b3-8e65-ba7005cef652] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:00:07.460047710Z [2024-02-23 04:00:07,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:00:08.745825062Z [2024-02-23 04:00:08,745: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:00:08.749187046Z [2024-02-23 04:00:08,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:08.767859604Z [2024-02-23 04:00:08,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:00:08.769127268Z [2024-02-23 04:00:08,768: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:00:08.769190383Z [2024-02-23 04:00:08,769: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:00:08.769332591Z [2024-02-23 04:00:08,769: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:00:08.769368675Z [2024-02-23 04:00:08,769: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:00:08.769794599Z [2024-02-23 04:00:08,769: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:00:08.769871611Z [2024-02-23 04:00:08,769: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:00:08.872263802Z [2024-02-23 04:00:08,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:10.204419966Z [2024-02-23 04:00:10,203: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de90db45-8bfb-43b3-8e65-ba7005cef652] succeeded in 3.0280156190019625s: None 2024-02-23T04:00:10.782858362Z [2024-02-23 04:00:10,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2e16cd1-cecb-47ab-98ac-64086313114d] received 2024-02-23T04:00:10.789887803Z [2024-02-23 04:00:10,789: INFO/ForkPoolWorker-15] [e2e16cd1-cecb-47ab-98ac-64086313114d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:00:11.064090840Z [2024-02-23 04:00:11,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:00:12.164752950Z [2024-02-23 04:00:12,164: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:00:12.167993496Z [2024-02-23 04:00:12,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:00:12.189048928Z [2024-02-23 04:00:12,188: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:00:12.190599175Z [2024-02-23 04:00:12,190: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:00:12.190737571Z [2024-02-23 04:00:12,190: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:00:12.191035340Z [2024-02-23 04:00:12,190: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:00:12.191214809Z [2024-02-23 04:00:12,191: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:00:12.191589611Z [2024-02-23 04:00:12,191: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:00:12.191772372Z [2024-02-23 04:00:12,191: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:00:12.295205889Z [2024-02-23 04:00:12,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:00:12.772367740Z [2024-02-23 04:00:12,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2e16cd1-cecb-47ab-98ac-64086313114d] succeeded in 1.9874075389998325s: None 2024-02-23T04:01:00.443845101Z [2024-02-23 04:01:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfa72b03-9331-41da-9b1b-dbe10dc7fdf5] received 2024-02-23T04:01:00.459241750Z [2024-02-23 04:01:00,458: INFO/ForkPoolWorker-15] [bfa72b03-9331-41da-9b1b-dbe10dc7fdf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:01:00.464563796Z [2024-02-23 04:01:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef6baa5a-8df6-4b50-b335-433254fb71b6] received 2024-02-23T04:01:00.469046885Z [2024-02-23 04:01:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5b9f299-861d-44d8-b137-34949fa7c15e] received 2024-02-23T04:01:00.475433581Z [2024-02-23 04:01:00,475: INFO/ForkPoolWorker-16] [ef6baa5a-8df6-4b50-b335-433254fb71b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:01:00.490805559Z [2024-02-23 04:01:00,490: INFO/ForkPoolWorker-1] [e5b9f299-861d-44d8-b137-34949fa7c15e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:01:00.818958290Z [2024-02-23 04:01:00,814: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:01:00.858242579Z [2024-02-23 04:01:00,855: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:01:00.873409584Z [2024-02-23 04:01:00,870: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:01:00.999210261Z [2024-02-23 04:01:00,998: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:01:01.003747874Z [2024-02-23 04:01:01,003: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:01:01.038924688Z [2024-02-23 04:01:01,038: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:01:01.043644978Z [2024-02-23 04:01:01,043: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:01:01.044042954Z [2024-02-23 04:01:01,043: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:01:01.044300810Z [2024-02-23 04:01:01,044: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:01:01.044738004Z [2024-02-23 04:01:01,044: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:01:01.174115562Z [2024-02-23 04:01:01,173: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:01:01.860465413Z [2024-02-23 04:01:01,860: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5b9f299-861d-44d8-b137-34949fa7c15e] succeeded in 1.3836368699994637s: None 2024-02-23T04:01:02.326294193Z [2024-02-23 04:01:02,325: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:01:02.329711943Z [2024-02-23 04:01:02,329: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:01:02.354665156Z [2024-02-23 04:01:02,354: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:01:02.357081602Z [2024-02-23 04:01:02,356: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:01:02.358473340Z [2024-02-23 04:01:02,358: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:01:02.358650426Z [2024-02-23 04:01:02,358: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:01:02.359103349Z [2024-02-23 04:01:02,358: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:01:02.359289006Z [2024-02-23 04:01:02,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:01:02.359771984Z [2024-02-23 04:01:02,359: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:01:02.359929001Z [2024-02-23 04:01:02,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:01:02.359973835Z [2024-02-23 04:01:02,359: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:01:02.391650812Z [2024-02-23 04:01:02,391: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:01:02.393058367Z [2024-02-23 04:01:02,392: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:01:02.393079490Z [2024-02-23 04:01:02,392: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:01:02.393242618Z [2024-02-23 04:01:02,393: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:01:02.393309297Z [2024-02-23 04:01:02,393: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:01:02.393573565Z [2024-02-23 04:01:02,393: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:01:02.393587264Z [2024-02-23 04:01:02,393: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:01:02.479807608Z [2024-02-23 04:01:02,479: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:01:02.505336021Z [2024-02-23 04:01:02,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:01:04.884329863Z [2024-02-23 04:01:04,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef6baa5a-8df6-4b50-b335-433254fb71b6] succeeded in 4.41786029299692s: None 2024-02-23T04:01:05.130781888Z [2024-02-23 04:01:05,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfa72b03-9331-41da-9b1b-dbe10dc7fdf5] succeeded in 4.683541780002997s: None 2024-02-23T04:02:00.347468558Z [2024-02-23 04:02:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21655d0a-f3db-4ea9-b7ec-0aaeb7b45fd5] received 2024-02-23T04:02:00.353043911Z [2024-02-23 04:02:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4303db5e-3779-43bb-89ec-66116b2a3554] received 2024-02-23T04:02:00.357124564Z [2024-02-23 04:02:00,356: INFO/ForkPoolWorker-15] [21655d0a-f3db-4ea9-b7ec-0aaeb7b45fd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:02:00.359882164Z [2024-02-23 04:02:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6533adfc-22a0-4475-91a3-1098c742e076] received 2024-02-23T04:02:00.361784702Z [2024-02-23 04:02:00,361: INFO/ForkPoolWorker-16] [4303db5e-3779-43bb-89ec-66116b2a3554] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:02:00.367131900Z [2024-02-23 04:02:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[373948e3-0d88-4a30-85bb-fc8894d990fc] received 2024-02-23T04:02:00.381504973Z [2024-02-23 04:02:00,381: INFO/ForkPoolWorker-1] [6533adfc-22a0-4475-91a3-1098c742e076] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:02:00.381866243Z [2024-02-23 04:02:00,381: INFO/ForkPoolWorker-2] [373948e3-0d88-4a30-85bb-fc8894d990fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:02:00.671560440Z [2024-02-23 04:02:00,668: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:02:00.689831829Z [2024-02-23 04:02:00,686: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:02:00.702098412Z [2024-02-23 04:02:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:02:00.710652451Z [2024-02-23 04:02:00,706: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:02:00.853791993Z [2024-02-23 04:02:00,853: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:02:00.857859145Z [2024-02-23 04:02:00,857: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:02:00.888534886Z [2024-02-23 04:02:00,888: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:02:00.890017836Z [2024-02-23 04:02:00,889: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:02:00.890058225Z [2024-02-23 04:02:00,889: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:02:00.890254120Z [2024-02-23 04:02:00,890: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:02:00.890481554Z [2024-02-23 04:02:00,890: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:02:01.025495289Z [2024-02-23 04:02:01,025: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:02:01.064319725Z [2024-02-23 04:02:01,064: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:02:01.719776400Z [2024-02-23 04:02:01,719: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21655d0a-f3db-4ea9-b7ec-0aaeb7b45fd5] succeeded in 1.3696171419978782s: None 2024-02-23T04:02:01.812755288Z [2024-02-23 04:02:01,812: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[373948e3-0d88-4a30-85bb-fc8894d990fc] succeeded in 1.4437079739982437s: None 2024-02-23T04:02:02.103153606Z [2024-02-23 04:02:02,102: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:02:02.106620068Z [2024-02-23 04:02:02,106: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:02:02.123722491Z [2024-02-23 04:02:02,123: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:02:02.125635257Z [2024-02-23 04:02:02,125: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:02:02.125832642Z [2024-02-23 04:02:02,125: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:02:02.126013843Z [2024-02-23 04:02:02,125: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:02:02.126072149Z [2024-02-23 04:02:02,125: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:02:02.126352150Z [2024-02-23 04:02:02,126: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:02:02.126485487Z [2024-02-23 04:02:02,126: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:02:02.175132259Z [2024-02-23 04:02:02,174: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:02:02.178809094Z [2024-02-23 04:02:02,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:02:02.212650075Z [2024-02-23 04:02:02,212: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:02:02.214669114Z [2024-02-23 04:02:02,214: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:02:02.215014757Z [2024-02-23 04:02:02,214: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:02:02.215478560Z [2024-02-23 04:02:02,214: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:02:02.215902263Z [2024-02-23 04:02:02,215: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:02:02.216322399Z [2024-02-23 04:02:02,216: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:02:02.216967731Z [2024-02-23 04:02:02,216: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:02:02.242165779Z [2024-02-23 04:02:02,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:02:02.321003645Z [2024-02-23 04:02:02,320: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:02:03.941054795Z [2024-02-23 04:02:03,940: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6533adfc-22a0-4475-91a3-1098c742e076] succeeded in 3.578928780996648s: None 2024-02-23T04:02:04.444140687Z [2024-02-23 04:02:04,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4303db5e-3779-43bb-89ec-66116b2a3554] succeeded in 4.089588331000414s: None 2024-02-23T04:03:01.142211555Z [2024-02-23 04:03:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[647827c1-ab53-489d-8e02-9802380b0ce3] received 2024-02-23T04:03:01.144589901Z [2024-02-23 04:03:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aaf84b5-dd77-4c75-aa27-36702ed743e7] received 2024-02-23T04:03:01.151292530Z [2024-02-23 04:03:01,151: INFO/ForkPoolWorker-15] [647827c1-ab53-489d-8e02-9802380b0ce3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:03:01.151600435Z [2024-02-23 04:03:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f7850f8-97ce-415f-9331-b366d72497f2] received 2024-02-23T04:03:01.155714416Z [2024-02-23 04:03:01,155: INFO/ForkPoolWorker-16] [2aaf84b5-dd77-4c75-aa27-36702ed743e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:03:01.162599657Z [2024-02-23 04:03:01,162: INFO/ForkPoolWorker-1] [1f7850f8-97ce-415f-9331-b366d72497f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:03:01.452994003Z [2024-02-23 04:03:01,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:03:01.470715439Z [2024-02-23 04:03:01,467: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:03:01.482241952Z [2024-02-23 04:03:01,479: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:03:01.641182784Z [2024-02-23 04:03:01,640: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:03:01.645518803Z [2024-02-23 04:03:01,645: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:03:01.667751689Z [2024-02-23 04:03:01,667: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:03:01.668869919Z [2024-02-23 04:03:01,668: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:03:01.668990057Z [2024-02-23 04:03:01,668: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:03:01.669063473Z [2024-02-23 04:03:01,668: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:03:01.669317173Z [2024-02-23 04:03:01,669: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:03:01.769954541Z [2024-02-23 04:03:01,769: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:03:02.472763449Z [2024-02-23 04:03:02,472: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f7850f8-97ce-415f-9331-b366d72497f2] succeeded in 1.3194527939995169s: None 2024-02-23T04:03:02.604133980Z [2024-02-23 04:03:02,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:03:02.607654024Z [2024-02-23 04:03:02,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:03:02.628078573Z [2024-02-23 04:03:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:03:02.629573002Z [2024-02-23 04:03:02,629: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:03:02.629725299Z [2024-02-23 04:03:02,629: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:03:02.629963156Z [2024-02-23 04:03:02,629: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:03:02.630112923Z [2024-02-23 04:03:02,629: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:03:02.631052315Z [2024-02-23 04:03:02,630: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:03:02.631212847Z [2024-02-23 04:03:02,630: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:03:02.711730140Z [2024-02-23 04:03:02,711: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:03:02.716517643Z [2024-02-23 04:03:02,716: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:03:02.721338588Z [2024-02-23 04:03:02,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:03:02.764557579Z [2024-02-23 04:03:02,764: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:03:02.771117092Z [2024-02-23 04:03:02,770: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:03:02.771275168Z [2024-02-23 04:03:02,770: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:03:02.771430888Z [2024-02-23 04:03:02,771: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:03:02.771509655Z [2024-02-23 04:03:02,771: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:03:02.771803693Z [2024-02-23 04:03:02,771: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:03:02.771890607Z [2024-02-23 04:03:02,771: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:03:02.961997607Z [2024-02-23 04:03:02,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:03:04.650447709Z [2024-02-23 04:03:04,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[647827c1-ab53-489d-8e02-9802380b0ce3] succeeded in 3.504405137999129s: None 2024-02-23T04:03:05.571941161Z [2024-02-23 04:03:05,571: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2aaf84b5-dd77-4c75-aa27-36702ed743e7] succeeded in 4.42404637999789s: None 2024-02-23T04:04:01.058567506Z [2024-02-23 04:04:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf2c983a-2f18-4709-ac17-986fe7e36840] received 2024-02-23T04:04:01.065957994Z [2024-02-23 04:04:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c240936e-9679-4f14-8cf3-46c9a61477eb] received 2024-02-23T04:04:01.069337104Z [2024-02-23 04:04:01,069: INFO/ForkPoolWorker-15] [cf2c983a-2f18-4709-ac17-986fe7e36840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:04:01.070060067Z [2024-02-23 04:04:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d50215c-e873-4ede-8b09-62ce30a58ea8] received 2024-02-23T04:04:01.075433633Z [2024-02-23 04:04:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01b905d8-a573-4531-870e-4b502a4c2602] received 2024-02-23T04:04:01.075749153Z [2024-02-23 04:04:01,075: INFO/ForkPoolWorker-16] [c240936e-9679-4f14-8cf3-46c9a61477eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:04:01.085565371Z [2024-02-23 04:04:01,085: INFO/ForkPoolWorker-1] [6d50215c-e873-4ede-8b09-62ce30a58ea8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:04:01.100752990Z [2024-02-23 04:04:01,100: INFO/ForkPoolWorker-2] [01b905d8-a573-4531-870e-4b502a4c2602] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:04:01.354738221Z [2024-02-23 04:04:01,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:04:01.425689490Z [2024-02-23 04:04:01,422: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:04:01.544851539Z [2024-02-23 04:04:01,541: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:04:01.548193212Z [2024-02-23 04:04:01,545: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:04:01.739767978Z [2024-02-23 04:04:01,739: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:04:01.748464887Z [2024-02-23 04:04:01,747: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:04:01.800546174Z [2024-02-23 04:04:01,800: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:04:01.804233402Z [2024-02-23 04:04:01,803: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:04:01.804647711Z [2024-02-23 04:04:01,804: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:04:01.805063802Z [2024-02-23 04:04:01,804: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:04:01.805572540Z [2024-02-23 04:04:01,805: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:04:01.815248234Z [2024-02-23 04:04:01,815: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:04:01.930603091Z [2024-02-23 04:04:01,930: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:04:02.443582300Z [2024-02-23 04:04:02,443: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d50215c-e873-4ede-8b09-62ce30a58ea8] succeeded in 1.3701838330016471s: None 2024-02-23T04:04:02.499274419Z [2024-02-23 04:04:02,498: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c240936e-9679-4f14-8cf3-46c9a61477eb] succeeded in 1.430557719002536s: None 2024-02-23T04:04:02.661180663Z [2024-02-23 04:04:02,660: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:04:02.664865924Z [2024-02-23 04:04:02,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:04:02.687890187Z [2024-02-23 04:04:02,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:04:02.689623582Z [2024-02-23 04:04:02,689: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:04:02.690134669Z [2024-02-23 04:04:02,689: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:04:02.690412713Z [2024-02-23 04:04:02,690: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:04:02.690607398Z [2024-02-23 04:04:02,690: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:04:02.691124250Z [2024-02-23 04:04:02,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:04:02.691246452Z [2024-02-23 04:04:02,691: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:04:02.763004552Z [2024-02-23 04:04:02,762: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:04:02.766427996Z [2024-02-23 04:04:02,765: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:04:02.789161528Z [2024-02-23 04:04:02,788: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:04:02.790500963Z [2024-02-23 04:04:02,790: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:04:02.790661924Z [2024-02-23 04:04:02,790: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:04:02.790800529Z [2024-02-23 04:04:02,790: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:04:02.790985523Z [2024-02-23 04:04:02,790: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:04:02.791346522Z [2024-02-23 04:04:02,791: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:04:02.791459180Z [2024-02-23 04:04:02,791: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:04:02.793418257Z [2024-02-23 04:04:02,793: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:04:02.904767472Z [2024-02-23 04:04:02,904: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:04:04.329324882Z [2024-02-23 04:04:04,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf2c983a-2f18-4709-ac17-986fe7e36840] succeeded in 3.2681050579994917s: None 2024-02-23T04:04:04.814568931Z [2024-02-23 04:04:04,813: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01b905d8-a573-4531-870e-4b502a4c2602] succeeded in 3.735159774998465s: None 2024-02-23T04:05:00.648141085Z [2024-02-23 04:05:00,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f38194c6-4b4a-49bf-9ce2-cbec13c866ee] received 2024-02-23T04:05:00.653197343Z [2024-02-23 04:05:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[477fabc1-8230-4c50-9559-1cfbf5f2f011] received 2024-02-23T04:05:00.658395072Z [2024-02-23 04:05:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62d96d8c-288a-4111-9c58-7612d9ca23b4] received 2024-02-23T04:05:00.660614272Z [2024-02-23 04:05:00,660: INFO/ForkPoolWorker-15] [f38194c6-4b4a-49bf-9ce2-cbec13c866ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:05:00.661125960Z [2024-02-23 04:05:00,660: INFO/ForkPoolWorker-16] [477fabc1-8230-4c50-9559-1cfbf5f2f011] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:05:00.668533539Z [2024-02-23 04:05:00,668: INFO/ForkPoolWorker-1] [62d96d8c-288a-4111-9c58-7612d9ca23b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:05:00.671466916Z [2024-02-23 04:05:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed04776-f7e0-459a-bca9-ca431beffb2d] received 2024-02-23T04:05:00.685976648Z [2024-02-23 04:05:00,685: INFO/ForkPoolWorker-2] [8ed04776-f7e0-459a-bca9-ca431beffb2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:05:01.002010706Z [2024-02-23 04:05:00,998: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:05:01.058340325Z [2024-02-23 04:05:01,055: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:05:01.077936689Z [2024-02-23 04:05:01,074: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:05:01.094491041Z [2024-02-23 04:05:01,091: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:05:01.291390837Z [2024-02-23 04:05:01,290: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:05:01.295830873Z [2024-02-23 04:05:01,295: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:01.324589893Z [2024-02-23 04:05:01,324: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:05:01.325550127Z [2024-02-23 04:05:01,325: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:05:01.325614846Z [2024-02-23 04:05:01,325: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:05:01.325723181Z [2024-02-23 04:05:01,325: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:05:01.325941564Z [2024-02-23 04:05:01,325: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:05:01.410225671Z [2024-02-23 04:05:01,409: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:02.131784874Z [2024-02-23 04:05:02,131: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8ed04776-f7e0-459a-bca9-ca431beffb2d] succeeded in 1.4586504680009966s: None 2024-02-23T04:05:02.469776828Z [2024-02-23 04:05:02,469: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:05:02.478333125Z [2024-02-23 04:05:02,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:02.549417179Z [2024-02-23 04:05:02,549: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:05:02.554297521Z [2024-02-23 04:05:02,553: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:05:02.554523947Z [2024-02-23 04:05:02,554: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:05:02.554909600Z [2024-02-23 04:05:02,554: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:05:02.555175035Z [2024-02-23 04:05:02,555: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:05:02.556778979Z [2024-02-23 04:05:02,556: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:05:02.557735045Z [2024-02-23 04:05:02,556: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:05:02.677520341Z [2024-02-23 04:05:02,677: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:02.698717840Z [2024-02-23 04:05:02,698: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:05:02.702272187Z [2024-02-23 04:05:02,701: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:02.747332807Z [2024-02-23 04:05:02,747: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:05:02.755744220Z [2024-02-23 04:05:02,755: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:05:02.755871563Z [2024-02-23 04:05:02,755: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:05:02.756124583Z [2024-02-23 04:05:02,755: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:05:02.756133449Z [2024-02-23 04:05:02,756: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:05:02.756506823Z [2024-02-23 04:05:02,756: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:05:02.756619386Z [2024-02-23 04:05:02,756: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:05:02.893899666Z [2024-02-23 04:05:02,893: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:02.906316316Z [2024-02-23 04:05:02,905: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:05:02.909826864Z [2024-02-23 04:05:02,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:02.942308376Z [2024-02-23 04:05:02,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:05:02.948656159Z [2024-02-23 04:05:02,948: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:05:02.950273417Z [2024-02-23 04:05:02,949: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:05:02.951296770Z [2024-02-23 04:05:02,950: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:05:02.956507615Z [2024-02-23 04:05:02,956: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:05:02.958962391Z [2024-02-23 04:05:02,957: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:05:02.959625239Z [2024-02-23 04:05:02,958: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:05:03.194224869Z [2024-02-23 04:05:03,193: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:03.839664140Z [2024-02-23 04:05:03,839: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f38194c6-4b4a-49bf-9ce2-cbec13c866ee] succeeded in 3.1893570860011096s: None 2024-02-23T04:05:04.635189874Z [2024-02-23 04:05:04,634: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62d96d8c-288a-4111-9c58-7612d9ca23b4] succeeded in 3.9746136109970394s: None 2024-02-23T04:05:04.663306859Z [2024-02-23 04:05:04,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3af03d3f-ac8e-44d1-ac31-2d410ec348cc] received 2024-02-23T04:05:04.673605109Z [2024-02-23 04:05:04,673: INFO/ForkPoolWorker-15] [3af03d3f-ac8e-44d1-ac31-2d410ec348cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:05:04.945466285Z [2024-02-23 04:05:04,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[477fabc1-8230-4c50-9559-1cfbf5f2f011] succeeded in 4.29065289600112s: None 2024-02-23T04:05:05.067575200Z [2024-02-23 04:05:05,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:05:06.290521295Z [2024-02-23 04:05:06,290: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:05:06.293900536Z [2024-02-23 04:05:06,293: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:06.328241163Z [2024-02-23 04:05:06,327: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:05:06.330752682Z [2024-02-23 04:05:06,330: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:05:06.331112853Z [2024-02-23 04:05:06,330: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:05:06.331354199Z [2024-02-23 04:05:06,331: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:05:06.331475249Z [2024-02-23 04:05:06,331: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:05:06.331847997Z [2024-02-23 04:05:06,331: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:05:06.332384525Z [2024-02-23 04:05:06,332: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:05:06.433921851Z [2024-02-23 04:05:06,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:07.080291999Z [2024-02-23 04:05:07,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3af03d3f-ac8e-44d1-ac31-2d410ec348cc] succeeded in 2.414350088998617s: None 2024-02-23T04:05:07.296537641Z [2024-02-23 04:05:07,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0db00fe4-7075-4d4e-9523-0328e2642b22] received 2024-02-23T04:05:07.305268366Z [2024-02-23 04:05:07,304: INFO/ForkPoolWorker-15] [0db00fe4-7075-4d4e-9523-0328e2642b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:05:07.651051362Z [2024-02-23 04:05:07,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:05:08.854715177Z [2024-02-23 04:05:08,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:05:08.858145586Z [2024-02-23 04:05:08,857: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:08.889235108Z [2024-02-23 04:05:08,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:05:08.891449026Z [2024-02-23 04:05:08,891: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:05:08.891675582Z [2024-02-23 04:05:08,891: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:05:08.891911429Z [2024-02-23 04:05:08,891: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:05:08.892038409Z [2024-02-23 04:05:08,891: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:05:08.892429043Z [2024-02-23 04:05:08,892: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:05:08.892920607Z [2024-02-23 04:05:08,892: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:05:09.018331580Z [2024-02-23 04:05:09,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:10.432866333Z [2024-02-23 04:05:10,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0db00fe4-7075-4d4e-9523-0328e2642b22] succeeded in 3.133609890999651s: None 2024-02-23T04:05:10.845559800Z [2024-02-23 04:05:10,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7086811-3eb9-4740-bfa0-622456cc2b4b] received 2024-02-23T04:05:10.856361290Z [2024-02-23 04:05:10,856: INFO/ForkPoolWorker-15] [f7086811-3eb9-4740-bfa0-622456cc2b4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:05:11.132085191Z [2024-02-23 04:05:11,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:05:12.205908412Z [2024-02-23 04:05:12,205: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:05:12.209123112Z [2024-02-23 04:05:12,208: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:05:12.226849804Z [2024-02-23 04:05:12,226: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:05:12.228097982Z [2024-02-23 04:05:12,227: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:05:12.228281347Z [2024-02-23 04:05:12,228: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:05:12.228466384Z [2024-02-23 04:05:12,228: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:05:12.228613062Z [2024-02-23 04:05:12,228: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:05:12.228961368Z [2024-02-23 04:05:12,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:05:12.229373797Z [2024-02-23 04:05:12,228: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:05:12.316513339Z [2024-02-23 04:05:12,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:05:12.901221119Z [2024-02-23 04:05:12,900: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7086811-3eb9-4740-bfa0-622456cc2b4b] succeeded in 2.0530014040014066s: None 2024-02-23T04:06:00.592259455Z [2024-02-23 04:06:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[725e2d60-480b-49e8-9022-1813d7f35ace] received 2024-02-23T04:06:00.599156429Z [2024-02-23 04:06:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0419b35e-311e-4424-a866-725a2c7b0bce] received 2024-02-23T04:06:00.607297552Z [2024-02-23 04:06:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bedf6a27-c650-45bd-a514-8321cd176184] received 2024-02-23T04:06:00.609976752Z [2024-02-23 04:06:00,607: INFO/ForkPoolWorker-15] [725e2d60-480b-49e8-9022-1813d7f35ace] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:06:00.615228061Z [2024-02-23 04:06:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b1c3427-e2a2-428c-bd13-26590f66f58c] received 2024-02-23T04:06:00.615309209Z [2024-02-23 04:06:00,615: INFO/ForkPoolWorker-16] [0419b35e-311e-4424-a866-725a2c7b0bce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:06:00.616069436Z [2024-02-23 04:06:00,615: INFO/ForkPoolWorker-1] [bedf6a27-c650-45bd-a514-8321cd176184] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:06:00.620573919Z [2024-02-23 04:06:00,620: INFO/ForkPoolWorker-2] [4b1c3427-e2a2-428c-bd13-26590f66f58c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:06:00.919689695Z [2024-02-23 04:06:00,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:06:00.973472517Z [2024-02-23 04:06:00,970: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:06:01.130494877Z [2024-02-23 04:06:01,126: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:06:01.175436854Z [2024-02-23 04:06:01,172: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:06:01.249589530Z [2024-02-23 04:06:01,249: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:06:01.469848415Z [2024-02-23 04:06:01,469: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:06:01.473814816Z [2024-02-23 04:06:01,473: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:06:01.492841217Z [2024-02-23 04:06:01,492: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:06:01.493795264Z [2024-02-23 04:06:01,493: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:06:01.493901220Z [2024-02-23 04:06:01,493: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:06:01.493943329Z [2024-02-23 04:06:01,493: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:06:01.494226259Z [2024-02-23 04:06:01,494: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:06:01.644651676Z [2024-02-23 04:06:01,644: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:06:01.761497395Z [2024-02-23 04:06:01,761: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[725e2d60-480b-49e8-9022-1813d7f35ace] succeeded in 1.1659155669985921s: None 2024-02-23T04:06:02.249432783Z [2024-02-23 04:06:02,249: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bedf6a27-c650-45bd-a514-8321cd176184] succeeded in 1.6404144760017516s: None 2024-02-23T04:06:02.468870064Z [2024-02-23 04:06:02,468: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:06:02.472290699Z [2024-02-23 04:06:02,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:06:02.502597360Z [2024-02-23 04:06:02,502: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:06:02.504669001Z [2024-02-23 04:06:02,504: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:06:02.504876810Z [2024-02-23 04:06:02,504: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:06:02.504988300Z [2024-02-23 04:06:02,504: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:06:02.505201618Z [2024-02-23 04:06:02,505: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:06:02.505625189Z [2024-02-23 04:06:02,505: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:06:02.505911055Z [2024-02-23 04:06:02,505: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:06:02.531893455Z [2024-02-23 04:06:02,531: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:06:02.535105225Z [2024-02-23 04:06:02,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:06:02.563258574Z [2024-02-23 04:06:02,563: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:06:02.564684840Z [2024-02-23 04:06:02,564: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:06:02.564747416Z [2024-02-23 04:06:02,564: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:06:02.564839546Z [2024-02-23 04:06:02,564: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:06:02.564894120Z [2024-02-23 04:06:02,564: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:06:02.565191872Z [2024-02-23 04:06:02,565: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:06:02.565202834Z [2024-02-23 04:06:02,565: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:06:02.595233787Z [2024-02-23 04:06:02,594: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:06:02.683504733Z [2024-02-23 04:06:02,683: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:06:04.790184767Z [2024-02-23 04:06:04,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0419b35e-311e-4424-a866-725a2c7b0bce] succeeded in 4.1884888320018945s: None 2024-02-23T04:06:04.877705647Z [2024-02-23 04:06:04,877: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4b1c3427-e2a2-428c-bd13-26590f66f58c] succeeded in 4.260820850999153s: None 2024-02-23T04:06:56.458039638Z [2024-02-23 04:06:56,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56a096b4-cf5f-4d35-b7c7-1d272bbd3d02] received 2024-02-23T04:06:56.472785564Z [2024-02-23 04:06:56,472: INFO/ForkPoolWorker-15] [56a096b4-cf5f-4d35-b7c7-1d272bbd3d02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240223040655_539479', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-02-23T04:06:56.766037334Z [2024-02-23 04:06:56,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-02-23T04:06:57.043108945Z [2024-02-23 04:06:57,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:06:57.658433528Z [2024-02-23 04:06:57,657: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56a096b4-cf5f-4d35-b7c7-1d272bbd3d02] succeeded in 1.1971629450017645s: None 2024-02-23T04:07:00.355308980Z [2024-02-23 04:07:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae8d2ee9-98b3-4881-9d89-bf5abfb0c5ab] received 2024-02-23T04:07:00.356483277Z [2024-02-23 04:07:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e700e8f-8978-46f2-85b5-cbd99564fe8f] received 2024-02-23T04:07:00.359081782Z [2024-02-23 04:07:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7fb7535-2cd8-48d6-8ff7-5b599f2a06e9] received 2024-02-23T04:07:00.364067819Z [2024-02-23 04:07:00,363: INFO/ForkPoolWorker-15] [ae8d2ee9-98b3-4881-9d89-bf5abfb0c5ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:07:00.366320965Z [2024-02-23 04:07:00,366: INFO/ForkPoolWorker-1] [d7fb7535-2cd8-48d6-8ff7-5b599f2a06e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:07:00.371391448Z [2024-02-23 04:07:00,371: INFO/ForkPoolWorker-16] [6e700e8f-8978-46f2-85b5-cbd99564fe8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:07:00.659839789Z [2024-02-23 04:07:00,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:07:00.675824898Z [2024-02-23 04:07:00,672: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:07:00.677709719Z [2024-02-23 04:07:00,674: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:07:00.834113425Z [2024-02-23 04:07:00,833: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:07:00.838115848Z [2024-02-23 04:07:00,837: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:07:00.862905675Z [2024-02-23 04:07:00,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:07:00.864125313Z [2024-02-23 04:07:00,863: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:07:00.864456880Z [2024-02-23 04:07:00,864: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:07:00.864611859Z [2024-02-23 04:07:00,864: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:07:00.865179021Z [2024-02-23 04:07:00,865: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:07:00.960590728Z [2024-02-23 04:07:00,960: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:07:01.532217538Z [2024-02-23 04:07:01,531: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d7fb7535-2cd8-48d6-8ff7-5b599f2a06e9] succeeded in 1.1706797330007248s: None 2024-02-23T04:07:01.739805844Z [2024-02-23 04:07:01,739: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:07:01.743496566Z [2024-02-23 04:07:01,742: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:07:01.766525956Z [2024-02-23 04:07:01,766: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:07:01.767990865Z [2024-02-23 04:07:01,767: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:07:01.768144111Z [2024-02-23 04:07:01,767: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:07:01.768368484Z [2024-02-23 04:07:01,768: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:07:01.768496737Z [2024-02-23 04:07:01,768: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:07:01.768828205Z [2024-02-23 04:07:01,768: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:07:01.769006866Z [2024-02-23 04:07:01,768: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:07:01.834080406Z [2024-02-23 04:07:01,833: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:07:01.837454624Z [2024-02-23 04:07:01,837: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:07:01.857452207Z [2024-02-23 04:07:01,857: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:07:01.858511556Z [2024-02-23 04:07:01,858: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:07:01.858547051Z [2024-02-23 04:07:01,858: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:07:01.858764477Z [2024-02-23 04:07:01,858: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:07:01.859136664Z [2024-02-23 04:07:01,859: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:07:01.859377529Z [2024-02-23 04:07:01,859: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:07:01.859461169Z [2024-02-23 04:07:01,859: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:07:01.883559368Z [2024-02-23 04:07:01,883: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:07:01.952492253Z [2024-02-23 04:07:01,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:07:03.775076162Z [2024-02-23 04:07:03,774: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e700e8f-8978-46f2-85b5-cbd99564fe8f] succeeded in 3.4163842859998113s: None 2024-02-23T04:07:04.197669164Z [2024-02-23 04:07:04,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae8d2ee9-98b3-4881-9d89-bf5abfb0c5ab] succeeded in 3.8394847599993227s: None 2024-02-23T04:08:00.305676524Z [2024-02-23 04:08:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f41b16da-43ad-41f3-933a-d7262f657e28] received 2024-02-23T04:08:00.308530773Z [2024-02-23 04:08:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f7c97f1-bf54-4813-9286-d15aa853b19b] received 2024-02-23T04:08:00.312618623Z [2024-02-23 04:08:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d9ae315-506d-46f2-b633-9ba52bd26e44] received 2024-02-23T04:08:00.316595434Z [2024-02-23 04:08:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c23f1b-3873-43aa-ac73-8b08a416b916] received 2024-02-23T04:08:00.317580746Z [2024-02-23 04:08:00,317: INFO/ForkPoolWorker-15] [f41b16da-43ad-41f3-933a-d7262f657e28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:08:00.320307101Z [2024-02-23 04:08:00,320: INFO/ForkPoolWorker-16] [6f7c97f1-bf54-4813-9286-d15aa853b19b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:08:00.331806411Z [2024-02-23 04:08:00,331: INFO/ForkPoolWorker-1] [1d9ae315-506d-46f2-b633-9ba52bd26e44] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:08:00.335418957Z [2024-02-23 04:08:00,335: INFO/ForkPoolWorker-2] [95c23f1b-3873-43aa-ac73-8b08a416b916] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:08:00.643562245Z [2024-02-23 04:08:00,638: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:08:00.680843057Z [2024-02-23 04:08:00,677: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:08:00.782311450Z [2024-02-23 04:08:00,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:08:00.824036463Z [2024-02-23 04:08:00,820: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:08:00.909427463Z [2024-02-23 04:08:00,909: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:08:01.048195028Z [2024-02-23 04:08:01,047: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:08:01.054786028Z [2024-02-23 04:08:01,054: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:08:01.104024707Z [2024-02-23 04:08:01,103: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:08:01.107738005Z [2024-02-23 04:08:01,107: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:08:01.107810343Z [2024-02-23 04:08:01,107: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:08:01.107917466Z [2024-02-23 04:08:01,107: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:08:01.108213788Z [2024-02-23 04:08:01,108: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:08:01.232653279Z [2024-02-23 04:08:01,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:08:01.764074075Z [2024-02-23 04:08:01,763: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d9ae315-506d-46f2-b633-9ba52bd26e44] succeeded in 1.4442777650001517s: None 2024-02-23T04:08:01.893806473Z [2024-02-23 04:08:01,893: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f7c97f1-bf54-4813-9286-d15aa853b19b] succeeded in 1.5826625539993984s: None 2024-02-23T04:08:01.904748491Z [2024-02-23 04:08:01,904: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:08:01.908076475Z [2024-02-23 04:08:01,907: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:08:01.928877092Z [2024-02-23 04:08:01,928: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:08:01.930036969Z [2024-02-23 04:08:01,929: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:08:01.930117673Z [2024-02-23 04:08:01,929: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:08:01.930328307Z [2024-02-23 04:08:01,929: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:08:01.930363340Z [2024-02-23 04:08:01,930: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:08:01.930621092Z [2024-02-23 04:08:01,930: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:08:01.930675233Z [2024-02-23 04:08:01,930: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:08:02.033072238Z [2024-02-23 04:08:02,032: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:08:02.131631916Z [2024-02-23 04:08:02,131: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:08:02.135007680Z [2024-02-23 04:08:02,134: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:08:02.167883823Z [2024-02-23 04:08:02,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:08:02.176337096Z [2024-02-23 04:08:02,175: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:08:02.176384051Z [2024-02-23 04:08:02,176: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:08:02.176531676Z [2024-02-23 04:08:02,176: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:08:02.176556342Z [2024-02-23 04:08:02,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:08:02.176906346Z [2024-02-23 04:08:02,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:08:02.176985327Z [2024-02-23 04:08:02,176: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:08:02.267386083Z [2024-02-23 04:08:02,267: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:08:03.932990447Z [2024-02-23 04:08:03,932: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95c23f1b-3873-43aa-ac73-8b08a416b916] succeeded in 3.6145190930001263s: None 2024-02-23T04:08:04.048332820Z [2024-02-23 04:08:04,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f41b16da-43ad-41f3-933a-d7262f657e28] succeeded in 3.7384736919993884s: None 2024-02-23T04:09:00.711762923Z [2024-02-23 04:09:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[276a7f51-48c1-4e03-ba35-0e82b85cbce9] received 2024-02-23T04:09:00.713236736Z [2024-02-23 04:09:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7fd8bc4-e425-43fa-a586-80213c426313] received 2024-02-23T04:09:00.718907045Z [2024-02-23 04:09:00,718: INFO/ForkPoolWorker-15] [276a7f51-48c1-4e03-ba35-0e82b85cbce9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:09:00.720020290Z [2024-02-23 04:09:00,719: INFO/ForkPoolWorker-16] [e7fd8bc4-e425-43fa-a586-80213c426313] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:09:00.750366543Z [2024-02-23 04:09:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b167df-ba4b-49e3-bb11-781d48f1c2e6] received 2024-02-23T04:09:00.763061383Z [2024-02-23 04:09:00,762: INFO/ForkPoolWorker-1] [59b167df-ba4b-49e3-bb11-781d48f1c2e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:09:01.032590762Z [2024-02-23 04:09:01,029: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:09:01.074028791Z [2024-02-23 04:09:01,070: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:09:01.228046542Z [2024-02-23 04:09:01,223: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:09:01.430557805Z [2024-02-23 04:09:01,430: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:09:01.434706382Z [2024-02-23 04:09:01,434: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:09:01.463731524Z [2024-02-23 04:09:01,463: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:09:01.465167156Z [2024-02-23 04:09:01,464: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:09:01.465340813Z [2024-02-23 04:09:01,465: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:09:01.465495369Z [2024-02-23 04:09:01,465: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:09:01.465809439Z [2024-02-23 04:09:01,465: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:09:01.571821122Z [2024-02-23 04:09:01,571: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:09:02.217326785Z [2024-02-23 04:09:02,216: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7fd8bc4-e425-43fa-a586-80213c426313] succeeded in 1.502618739999889s: None 2024-02-23T04:09:02.505495504Z [2024-02-23 04:09:02,505: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:09:02.509235682Z [2024-02-23 04:09:02,508: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:09:02.527844382Z [2024-02-23 04:09:02,527: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:09:02.529181360Z [2024-02-23 04:09:02,528: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:09:02.529332538Z [2024-02-23 04:09:02,529: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:09:02.529486782Z [2024-02-23 04:09:02,529: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:09:02.529608782Z [2024-02-23 04:09:02,529: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:09:02.529836573Z [2024-02-23 04:09:02,529: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:09:02.529920866Z [2024-02-23 04:09:02,529: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:09:02.595225377Z [2024-02-23 04:09:02,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:09:02.598646101Z [2024-02-23 04:09:02,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:09:02.631125123Z [2024-02-23 04:09:02,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:09:02.635016353Z [2024-02-23 04:09:02,634: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:09:02.635412983Z [2024-02-23 04:09:02,635: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:09:02.635674154Z [2024-02-23 04:09:02,635: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:09:02.635803622Z [2024-02-23 04:09:02,635: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:09:02.636158607Z [2024-02-23 04:09:02,636: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:09:02.636318500Z [2024-02-23 04:09:02,636: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:09:02.655646419Z [2024-02-23 04:09:02,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:09:02.719415749Z [2024-02-23 04:09:02,719: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:09:04.583451375Z [2024-02-23 04:09:04,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[276a7f51-48c1-4e03-ba35-0e82b85cbce9] succeeded in 3.8699124449994997s: None 2024-02-23T04:09:04.665135462Z [2024-02-23 04:09:04,664: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59b167df-ba4b-49e3-bb11-781d48f1c2e6] succeeded in 3.912800395002705s: None 2024-02-23T04:10:00.675938246Z [2024-02-23 04:10:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64db0a05-9223-460a-b871-1dad16dc36b3] received 2024-02-23T04:10:00.677563845Z [2024-02-23 04:10:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d17d849-b297-4bc3-8ba1-40a07a6a534c] received 2024-02-23T04:10:00.685577146Z [2024-02-23 04:10:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef434cae-ffdf-482a-b845-99e2d22c2a8d] received 2024-02-23T04:10:00.687531929Z [2024-02-23 04:10:00,686: INFO/ForkPoolWorker-15] [64db0a05-9223-460a-b871-1dad16dc36b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:10:00.692265831Z [2024-02-23 04:10:00,691: INFO/ForkPoolWorker-16] [1d17d849-b297-4bc3-8ba1-40a07a6a534c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:10:00.694135885Z [2024-02-23 04:10:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab68da0e-055e-42a5-9b17-9148cb6d41bf] received 2024-02-23T04:10:00.698058406Z [2024-02-23 04:10:00,697: INFO/ForkPoolWorker-1] [ef434cae-ffdf-482a-b845-99e2d22c2a8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:10:00.698169760Z [2024-02-23 04:10:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a3bd0fe-9b14-4adc-85ad-c24861662e2d] received 2024-02-23T04:10:00.706454633Z [2024-02-23 04:10:00,706: INFO/ForkPoolWorker-2] [ab68da0e-055e-42a5-9b17-9148cb6d41bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:10:00.727300351Z [2024-02-23 04:10:00,726: INFO/ForkPoolWorker-3] [4a3bd0fe-9b14-4adc-85ad-c24861662e2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:10:00.992545452Z [2024-02-23 04:10:00,987: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:10:01.059288415Z [2024-02-23 04:10:01,055: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:10:01.165265158Z [2024-02-23 04:10:01,161: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:10:01.232098013Z [2024-02-23 04:10:01,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:10:01.310058446Z [2024-02-23 04:10:01,289: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:10:01.369447963Z [2024-02-23 04:10:01,369: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:01.570467482Z [2024-02-23 04:10:01,570: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T04:10:01.577211312Z [2024-02-23 04:10:01,576: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:01.620663245Z [2024-02-23 04:10:01,620: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T04:10:01.622889012Z [2024-02-23 04:10:01,622: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:10:01.623719884Z [2024-02-23 04:10:01,622: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:10:01.623867021Z [2024-02-23 04:10:01,623: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T04:10:01.624159456Z [2024-02-23 04:10:01,624: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:10:01.859578371Z [2024-02-23 04:10:01,859: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:02.101504573Z [2024-02-23 04:10:02,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d17d849-b297-4bc3-8ba1-40a07a6a534c] succeeded in 1.4218813869993028s: None 2024-02-23T04:10:02.668101566Z [2024-02-23 04:10:02,667: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4a3bd0fe-9b14-4adc-85ad-c24861662e2d] succeeded in 1.9665188699982536s: None 2024-02-23T04:10:02.772412310Z [2024-02-23 04:10:02,772: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:10:02.775981633Z [2024-02-23 04:10:02,775: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:02.811039674Z [2024-02-23 04:10:02,810: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:10:02.816106504Z [2024-02-23 04:10:02,815: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:10:02.816336307Z [2024-02-23 04:10:02,815: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:10:02.816620197Z [2024-02-23 04:10:02,816: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:10:02.816846279Z [2024-02-23 04:10:02,816: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:10:02.817420349Z [2024-02-23 04:10:02,817: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:10:02.817636850Z [2024-02-23 04:10:02,817: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:10:02.857373043Z [2024-02-23 04:10:02,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:10:02.860862747Z [2024-02-23 04:10:02,860: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:02.887372112Z [2024-02-23 04:10:02,886: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:10:02.889036664Z [2024-02-23 04:10:02,888: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:10:02.889531859Z [2024-02-23 04:10:02,889: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:10:02.889647991Z [2024-02-23 04:10:02,889: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:10:02.889690167Z [2024-02-23 04:10:02,889: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:10:02.889949122Z [2024-02-23 04:10:02,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:10:02.889978103Z [2024-02-23 04:10:02,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:10:02.925177167Z [2024-02-23 04:10:02,924: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:02.929065155Z [2024-02-23 04:10:02,928: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:10:02.932759048Z [2024-02-23 04:10:02,932: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:02.965682698Z [2024-02-23 04:10:02,965: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:10:02.968701170Z [2024-02-23 04:10:02,968: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:10:02.968728357Z [2024-02-23 04:10:02,968: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:10:02.968818769Z [2024-02-23 04:10:02,968: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:10:02.968834578Z [2024-02-23 04:10:02,968: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:10:02.969099678Z [2024-02-23 04:10:02,968: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:10:02.969125201Z [2024-02-23 04:10:02,969: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:10:02.983526257Z [2024-02-23 04:10:02,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:03.095376644Z [2024-02-23 04:10:03,095: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:03.696902092Z [2024-02-23 04:10:03,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[880737b6-c918-4577-b12e-a1be818e512c] received 2024-02-23T04:10:03.705085562Z [2024-02-23 04:10:03,704: INFO/ForkPoolWorker-16] [880737b6-c918-4577-b12e-a1be818e512c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:10:03.776466201Z [2024-02-23 04:10:03,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64db0a05-9223-460a-b871-1dad16dc36b3] succeeded in 3.0963553299989144s: None 2024-02-23T04:10:04.083630924Z [2024-02-23 04:10:04,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:10:04.700216605Z [2024-02-23 04:10:04,697: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ab68da0e-055e-42a5-9b17-9148cb6d41bf] succeeded in 4.000432498000009s: None 2024-02-23T04:10:05.108112617Z [2024-02-23 04:10:05,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef434cae-ffdf-482a-b845-99e2d22c2a8d] succeeded in 4.419173883001349s: None 2024-02-23T04:10:05.350970694Z [2024-02-23 04:10:05,346: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:10:05.355358812Z [2024-02-23 04:10:05,354: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:05.402526242Z [2024-02-23 04:10:05,402: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:10:05.404184890Z [2024-02-23 04:10:05,403: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:10:05.404461198Z [2024-02-23 04:10:05,404: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:10:05.404751338Z [2024-02-23 04:10:05,404: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:10:05.404917982Z [2024-02-23 04:10:05,404: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:10:05.405275841Z [2024-02-23 04:10:05,405: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:10:05.405477091Z [2024-02-23 04:10:05,405: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:10:05.520705584Z [2024-02-23 04:10:05,520: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:06.195726038Z [2024-02-23 04:10:06,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[880737b6-c918-4577-b12e-a1be818e512c] succeeded in 2.4964073070004815s: None 2024-02-23T04:10:06.386323728Z [2024-02-23 04:10:06,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2beec93d-4c11-4f82-aea1-92ebc24c5b7b] received 2024-02-23T04:10:06.401362093Z [2024-02-23 04:10:06,401: INFO/ForkPoolWorker-15] [2beec93d-4c11-4f82-aea1-92ebc24c5b7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:10:06.762291396Z [2024-02-23 04:10:06,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:10:07.985484006Z [2024-02-23 04:10:07,984: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:10:07.990097120Z [2024-02-23 04:10:07,989: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:08.035703772Z [2024-02-23 04:10:08,035: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:10:08.037203013Z [2024-02-23 04:10:08,036: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:10:08.037418406Z [2024-02-23 04:10:08,037: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:10:08.037662836Z [2024-02-23 04:10:08,037: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:10:08.037860620Z [2024-02-23 04:10:08,037: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:10:08.038300487Z [2024-02-23 04:10:08,038: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:10:08.038529358Z [2024-02-23 04:10:08,038: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:10:08.132432729Z [2024-02-23 04:10:08,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:08.740324332Z [2024-02-23 04:10:08,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd702eff-4bfc-4ba1-a17a-6c1b70a06e07] received 2024-02-23T04:10:08.749616295Z [2024-02-23 04:10:08,748: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2beec93d-4c11-4f82-aea1-92ebc24c5b7b] succeeded in 2.3585153650019492s: None 2024-02-23T04:10:08.756892906Z [2024-02-23 04:10:08,756: INFO/ForkPoolWorker-16] [dd702eff-4bfc-4ba1-a17a-6c1b70a06e07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:10:09.025409450Z [2024-02-23 04:10:09,022: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:10:10.130485319Z [2024-02-23 04:10:10,130: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:10:10.133705395Z [2024-02-23 04:10:10,133: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:10:10.164789905Z [2024-02-23 04:10:10,164: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:10:10.167029741Z [2024-02-23 04:10:10,166: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:10:10.167217736Z [2024-02-23 04:10:10,167: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:10:10.167450344Z [2024-02-23 04:10:10,167: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:10:10.167606583Z [2024-02-23 04:10:10,167: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:10:10.168078657Z [2024-02-23 04:10:10,167: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:10:10.168199786Z [2024-02-23 04:10:10,168: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:10:10.280561900Z [2024-02-23 04:10:10,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:10.964016745Z [2024-02-23 04:10:10,963: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd702eff-4bfc-4ba1-a17a-6c1b70a06e07] succeeded in 2.221498351998889s: None 2024-02-23T04:10:55.967715754Z [2024-02-23 04:10:55,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1528a4c7-3714-435c-a883-d5f9be843101] received 2024-02-23T04:10:55.978377337Z [2024-02-23 04:10:55,978: INFO/ForkPoolWorker-15] [1528a4c7-3714-435c-a883-d5f9be843101] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240223041055_601364', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-02-23T04:10:56.264991637Z [2024-02-23 04:10:56,262: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-02-23T04:10:56.495844488Z [2024-02-23 04:10:56,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:10:57.133435823Z [2024-02-23 04:10:57,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1528a4c7-3714-435c-a883-d5f9be843101] succeeded in 1.163163864002854s: None 2024-02-23T04:11:00.713831526Z [2024-02-23 04:11:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55cb170f-abc3-4203-bfd4-9edd47b97a0b] received 2024-02-23T04:11:00.719991866Z [2024-02-23 04:11:00,719: INFO/ForkPoolWorker-15] [55cb170f-abc3-4203-bfd4-9edd47b97a0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:11:00.721325786Z [2024-02-23 04:11:00,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7485d963-7a41-4345-8d8f-5c8aa7e0298f] received 2024-02-23T04:11:00.729037713Z [2024-02-23 04:11:00,728: INFO/ForkPoolWorker-16] [7485d963-7a41-4345-8d8f-5c8aa7e0298f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:11:00.729362721Z [2024-02-23 04:11:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bb224d8-11db-4554-8617-8a60aa561f32] received 2024-02-23T04:11:00.736549567Z [2024-02-23 04:11:00,736: INFO/ForkPoolWorker-1] [7bb224d8-11db-4554-8617-8a60aa561f32] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:11:01.021348965Z [2024-02-23 04:11:01,018: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:11:01.056304175Z [2024-02-23 04:11:01,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:11:01.088664438Z [2024-02-23 04:11:01,085: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:11:01.195691590Z [2024-02-23 04:11:01,195: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:11:01.203732550Z [2024-02-23 04:11:01,202: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:11:01.226505314Z [2024-02-23 04:11:01,226: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:11:01.227567466Z [2024-02-23 04:11:01,227: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:11:01.227657028Z [2024-02-23 04:11:01,227: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:11:01.227696311Z [2024-02-23 04:11:01,227: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:11:01.227902426Z [2024-02-23 04:11:01,227: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:11:01.314436513Z [2024-02-23 04:11:01,314: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:11:02.048319187Z [2024-02-23 04:11:02,047: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bb224d8-11db-4554-8617-8a60aa561f32] succeeded in 1.3167688930006989s: None 2024-02-23T04:11:02.379282634Z [2024-02-23 04:11:02,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:11:02.382792516Z [2024-02-23 04:11:02,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:11:02.408385426Z [2024-02-23 04:11:02,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:11:02.409911551Z [2024-02-23 04:11:02,409: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:11:02.410074790Z [2024-02-23 04:11:02,409: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:11:02.410237025Z [2024-02-23 04:11:02,410: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:11:02.410381106Z [2024-02-23 04:11:02,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:11:02.410790684Z [2024-02-23 04:11:02,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:11:02.410818766Z [2024-02-23 04:11:02,410: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:11:02.466739158Z [2024-02-23 04:11:02,466: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:11:02.470512837Z [2024-02-23 04:11:02,469: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:11:02.494143037Z [2024-02-23 04:11:02,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:11:02.496050824Z [2024-02-23 04:11:02,495: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:11:02.496102675Z [2024-02-23 04:11:02,495: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:11:02.496297663Z [2024-02-23 04:11:02,496: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:11:02.496384201Z [2024-02-23 04:11:02,496: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:11:02.496815622Z [2024-02-23 04:11:02,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:11:02.496988122Z [2024-02-23 04:11:02,496: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:11:02.501168758Z [2024-02-23 04:11:02,500: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:11:02.583695245Z [2024-02-23 04:11:02,583: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:11:05.001256509Z [2024-02-23 04:11:05,000: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7485d963-7a41-4345-8d8f-5c8aa7e0298f] succeeded in 4.277684129003319s: None 2024-02-23T04:11:05.069089160Z [2024-02-23 04:11:05,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55cb170f-abc3-4203-bfd4-9edd47b97a0b] succeeded in 4.353095065998787s: None 2024-02-23T04:12:00.675192819Z [2024-02-23 04:12:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb25f77a-2cb4-4b75-86e6-28fa20b29426] received 2024-02-23T04:12:00.682797462Z [2024-02-23 04:12:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64945257-3c6c-492b-af7b-11e052b6d9ed] received 2024-02-23T04:12:00.685006513Z [2024-02-23 04:12:00,684: INFO/ForkPoolWorker-15] [bb25f77a-2cb4-4b75-86e6-28fa20b29426] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:12:00.701460040Z [2024-02-23 04:12:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fb0b9ca-7039-4344-a1cd-31f5df577ec1] received 2024-02-23T04:12:00.709245552Z [2024-02-23 04:12:00,708: INFO/ForkPoolWorker-1] [2fb0b9ca-7039-4344-a1cd-31f5df577ec1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:12:00.709971545Z [2024-02-23 04:12:00,709: INFO/ForkPoolWorker-16] [64945257-3c6c-492b-af7b-11e052b6d9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:12:00.710659730Z [2024-02-23 04:12:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6337a5cb-ccd5-488f-aa56-0716e2ed3918] received 2024-02-23T04:12:00.727548045Z [2024-02-23 04:12:00,727: INFO/ForkPoolWorker-2] [6337a5cb-ccd5-488f-aa56-0716e2ed3918] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:12:01.097477314Z [2024-02-23 04:12:01,094: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:12:01.112632575Z [2024-02-23 04:12:01,109: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:12:01.147865004Z [2024-02-23 04:12:01,140: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:12:01.161593081Z [2024-02-23 04:12:01,158: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:12:01.352229654Z [2024-02-23 04:12:01,351: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:12:01.357347050Z [2024-02-23 04:12:01,356: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:12:01.385239431Z [2024-02-23 04:12:01,384: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:12:01.390183037Z [2024-02-23 04:12:01,389: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:12:01.390567064Z [2024-02-23 04:12:01,390: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:12:01.390925756Z [2024-02-23 04:12:01,390: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:12:01.393224967Z [2024-02-23 04:12:01,392: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:12:01.415319387Z [2024-02-23 04:12:01,415: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:12:01.509150792Z [2024-02-23 04:12:01,508: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:12:02.018085275Z [2024-02-23 04:12:02,017: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64945257-3c6c-492b-af7b-11e052b6d9ed] succeeded in 1.3143034130007436s: None 2024-02-23T04:12:02.221234209Z [2024-02-23 04:12:02,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6337a5cb-ccd5-488f-aa56-0716e2ed3918] succeeded in 1.5056804439991538s: None 2024-02-23T04:12:02.390802872Z [2024-02-23 04:12:02,389: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:12:02.394583119Z [2024-02-23 04:12:02,393: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:12:02.439862084Z [2024-02-23 04:12:02,439: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:12:02.444920708Z [2024-02-23 04:12:02,444: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:12:02.445055316Z [2024-02-23 04:12:02,444: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:12:02.445247885Z [2024-02-23 04:12:02,445: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:12:02.445357436Z [2024-02-23 04:12:02,445: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:12:02.445743673Z [2024-02-23 04:12:02,445: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:12:02.451145338Z [2024-02-23 04:12:02,448: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:12:02.552028240Z [2024-02-23 04:12:02,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:12:02.585305637Z [2024-02-23 04:12:02,584: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:12:02.589151096Z [2024-02-23 04:12:02,588: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:12:02.611440541Z [2024-02-23 04:12:02,611: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:12:02.612908093Z [2024-02-23 04:12:02,612: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:12:02.612976831Z [2024-02-23 04:12:02,612: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:12:02.613114970Z [2024-02-23 04:12:02,612: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:12:02.613161565Z [2024-02-23 04:12:02,613: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:12:02.613415937Z [2024-02-23 04:12:02,613: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:12:02.613475177Z [2024-02-23 04:12:02,613: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:12:02.715877623Z [2024-02-23 04:12:02,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:12:04.241497908Z [2024-02-23 04:12:04,240: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb25f77a-2cb4-4b75-86e6-28fa20b29426] succeeded in 3.5643577170012577s: None 2024-02-23T04:12:05.614652847Z [2024-02-23 04:12:05,614: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fb0b9ca-7039-4344-a1cd-31f5df577ec1] succeeded in 4.91162866599916s: None 2024-02-23T04:13:00.470026670Z [2024-02-23 04:13:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbce7c57-04a8-4f3c-8818-c4501a0b54f4] received 2024-02-23T04:13:00.475614008Z [2024-02-23 04:13:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56060d0c-8a67-4107-a52a-a99db844ed1c] received 2024-02-23T04:13:00.481218333Z [2024-02-23 04:13:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e85b4b27-4a90-47f6-98eb-86db3228fb2f] received 2024-02-23T04:13:00.487564605Z [2024-02-23 04:13:00,487: INFO/ForkPoolWorker-16] [56060d0c-8a67-4107-a52a-a99db844ed1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:13:00.487746921Z [2024-02-23 04:13:00,487: INFO/ForkPoolWorker-1] [e85b4b27-4a90-47f6-98eb-86db3228fb2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:13:00.489693801Z [2024-02-23 04:13:00,489: INFO/ForkPoolWorker-15] [cbce7c57-04a8-4f3c-8818-c4501a0b54f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:13:00.828354596Z [2024-02-23 04:13:00,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:13:00.860820290Z [2024-02-23 04:13:00,856: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:13:00.862483678Z [2024-02-23 04:13:00,857: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:13:01.030720863Z [2024-02-23 04:13:01,030: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:13:01.035309063Z [2024-02-23 04:13:01,034: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:13:01.052502195Z [2024-02-23 04:13:01,052: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:13:01.053924531Z [2024-02-23 04:13:01,053: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:13:01.054025930Z [2024-02-23 04:13:01,053: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:13:01.054118390Z [2024-02-23 04:13:01,054: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:13:01.054437744Z [2024-02-23 04:13:01,054: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:13:01.162032827Z [2024-02-23 04:13:01,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:13:01.799356273Z [2024-02-23 04:13:01,798: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[56060d0c-8a67-4107-a52a-a99db844ed1c] succeeded in 1.3204729509998288s: None 2024-02-23T04:13:02.019079559Z [2024-02-23 04:13:02,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:13:02.022356553Z [2024-02-23 04:13:02,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:13:02.058568184Z [2024-02-23 04:13:02,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:13:02.060530385Z [2024-02-23 04:13:02,060: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:13:02.060723174Z [2024-02-23 04:13:02,060: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:13:02.061051427Z [2024-02-23 04:13:02,060: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:13:02.061070023Z [2024-02-23 04:13:02,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:13:02.061443321Z [2024-02-23 04:13:02,061: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:13:02.062001678Z [2024-02-23 04:13:02,061: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:13:02.081103565Z [2024-02-23 04:13:02,080: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:13:02.084646727Z [2024-02-23 04:13:02,084: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:13:02.104348372Z [2024-02-23 04:13:02,104: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:13:02.106630639Z [2024-02-23 04:13:02,106: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:13:02.106977525Z [2024-02-23 04:13:02,106: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:13:02.107178370Z [2024-02-23 04:13:02,106: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:13:02.107289867Z [2024-02-23 04:13:02,107: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:13:02.107620870Z [2024-02-23 04:13:02,107: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:13:02.107784990Z [2024-02-23 04:13:02,107: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:13:02.159250881Z [2024-02-23 04:13:02,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:13:02.198645260Z [2024-02-23 04:13:02,198: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:13:03.766031166Z [2024-02-23 04:13:03,765: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e85b4b27-4a90-47f6-98eb-86db3228fb2f] succeeded in 3.283095274997322s: None 2024-02-23T04:13:04.164399276Z [2024-02-23 04:13:04,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbce7c57-04a8-4f3c-8818-c4501a0b54f4] succeeded in 3.6879266790019756s: None 2024-02-23T04:14:00.649643647Z [2024-02-23 04:14:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42e0d6b3-1989-42ef-ab1c-81268add63b7] received 2024-02-23T04:14:00.652227426Z [2024-02-23 04:14:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f65dcb06-a570-4bb4-8907-ba8a2cd8f30d] received 2024-02-23T04:14:00.658062678Z [2024-02-23 04:14:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed13c82d-db2c-4d59-9af0-18d7b62f9a5a] received 2024-02-23T04:14:00.659853162Z [2024-02-23 04:14:00,659: INFO/ForkPoolWorker-16] [f65dcb06-a570-4bb4-8907-ba8a2cd8f30d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:14:00.661966798Z [2024-02-23 04:14:00,661: INFO/ForkPoolWorker-15] [42e0d6b3-1989-42ef-ab1c-81268add63b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:14:00.662556041Z [2024-02-23 04:14:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0f1e7aa-2ad8-42ad-800e-5b168cc0afc6] received 2024-02-23T04:14:00.669950439Z [2024-02-23 04:14:00,669: INFO/ForkPoolWorker-2] [a0f1e7aa-2ad8-42ad-800e-5b168cc0afc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:14:00.679871083Z [2024-02-23 04:14:00,679: INFO/ForkPoolWorker-1] [ed13c82d-db2c-4d59-9af0-18d7b62f9a5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:14:01.067873819Z [2024-02-23 04:14:01,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:14:01.071860223Z [2024-02-23 04:14:01,068: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:14:01.084071657Z [2024-02-23 04:14:01,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:14:01.144411911Z [2024-02-23 04:14:01,141: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:14:01.411579890Z [2024-02-23 04:14:01,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:14:01.547921228Z [2024-02-23 04:14:01,547: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:14:01.564341893Z [2024-02-23 04:14:01,563: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:14:01.646066318Z [2024-02-23 04:14:01,645: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:14:01.647823090Z [2024-02-23 04:14:01,647: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:14:01.647881435Z [2024-02-23 04:14:01,647: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:14:01.647930618Z [2024-02-23 04:14:01,647: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:14:01.648135981Z [2024-02-23 04:14:01,648: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:14:01.890816331Z [2024-02-23 04:14:01,890: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:14:02.337370423Z [2024-02-23 04:14:02,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42e0d6b3-1989-42ef-ab1c-81268add63b7] succeeded in 1.6834639240005345s: None 2024-02-23T04:14:02.945855260Z [2024-02-23 04:14:02,945: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:14:02.945934678Z [2024-02-23 04:14:02,945: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a0f1e7aa-2ad8-42ad-800e-5b168cc0afc6] succeeded in 2.2820547929986787s: None 2024-02-23T04:14:02.949831683Z [2024-02-23 04:14:02,949: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:14:02.996079936Z [2024-02-23 04:14:02,995: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:14:03.002387008Z [2024-02-23 04:14:03,002: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:14:03.002645538Z [2024-02-23 04:14:03,002: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:14:03.002886767Z [2024-02-23 04:14:03,002: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:14:03.008819226Z [2024-02-23 04:14:03,004: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:14:03.009679495Z [2024-02-23 04:14:03,009: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:14:03.009969952Z [2024-02-23 04:14:03,009: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:14:03.119528945Z [2024-02-23 04:14:03,119: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:14:03.327812322Z [2024-02-23 04:14:03,327: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:14:03.331489655Z [2024-02-23 04:14:03,331: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:14:03.367033957Z [2024-02-23 04:14:03,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:14:03.368640216Z [2024-02-23 04:14:03,368: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:14:03.368895963Z [2024-02-23 04:14:03,368: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:14:03.369139190Z [2024-02-23 04:14:03,368: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:14:03.369303909Z [2024-02-23 04:14:03,369: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:14:03.369660530Z [2024-02-23 04:14:03,369: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:14:03.369848479Z [2024-02-23 04:14:03,369: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:14:03.475111035Z [2024-02-23 04:14:03,474: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:14:05.017457573Z [2024-02-23 04:14:05,017: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed13c82d-db2c-4d59-9af0-18d7b62f9a5a] succeeded in 4.352962235996529s: None 2024-02-23T04:14:05.844404914Z [2024-02-23 04:14:05,843: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f65dcb06-a570-4bb4-8907-ba8a2cd8f30d] succeeded in 5.190480253000715s: None 2024-02-23T04:15:00.295482936Z [2024-02-23 04:15:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5794c9d-f2c5-4c33-b465-9b7013d1f3bb] received 2024-02-23T04:15:00.299409097Z [2024-02-23 04:15:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9790cff-b70d-4760-9ad2-e57aecfe4ffd] received 2024-02-23T04:15:00.305127200Z [2024-02-23 04:15:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec2f90fb-400a-4c71-8f68-7648442d9007] received 2024-02-23T04:15:00.306200684Z [2024-02-23 04:15:00,305: INFO/ForkPoolWorker-15] [a5794c9d-f2c5-4c33-b465-9b7013d1f3bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:15:00.306445535Z [2024-02-23 04:15:00,306: INFO/ForkPoolWorker-16] [e9790cff-b70d-4760-9ad2-e57aecfe4ffd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:15:00.310207799Z [2024-02-23 04:15:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e7106ea-fcb2-459c-97c1-f468914faca2] received 2024-02-23T04:15:00.316615835Z [2024-02-23 04:15:00,316: INFO/ForkPoolWorker-1] [ec2f90fb-400a-4c71-8f68-7648442d9007] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:15:00.319610891Z [2024-02-23 04:15:00,319: INFO/ForkPoolWorker-2] [8e7106ea-fcb2-459c-97c1-f468914faca2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:15:00.603921571Z [2024-02-23 04:15:00,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:15:00.639009525Z [2024-02-23 04:15:00,636: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:15:00.721936553Z [2024-02-23 04:15:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:15:00.738207910Z [2024-02-23 04:15:00,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:15:00.785265198Z [2024-02-23 04:15:00,784: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:15:00.789295233Z [2024-02-23 04:15:00,788: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:00.828547489Z [2024-02-23 04:15:00,828: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:15:00.832303311Z [2024-02-23 04:15:00,832: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:15:00.832453634Z [2024-02-23 04:15:00,832: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:15:00.832585726Z [2024-02-23 04:15:00,832: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:15:00.835930667Z [2024-02-23 04:15:00,835: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:15:00.961550700Z [2024-02-23 04:15:00,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:01.518728077Z [2024-02-23 04:15:01,518: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9790cff-b70d-4760-9ad2-e57aecfe4ffd] succeeded in 1.2176233360005426s: None 2024-02-23T04:15:01.911740020Z [2024-02-23 04:15:01,911: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:15:01.914996863Z [2024-02-23 04:15:01,914: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:01.937400638Z [2024-02-23 04:15:01,937: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:15:01.938678578Z [2024-02-23 04:15:01,938: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:15:01.938690485Z [2024-02-23 04:15:01,938: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:15:01.938817157Z [2024-02-23 04:15:01,938: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:15:01.938925044Z [2024-02-23 04:15:01,938: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:15:01.939405886Z [2024-02-23 04:15:01,939: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:15:01.939414997Z [2024-02-23 04:15:01,939: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:15:02.022514530Z [2024-02-23 04:15:02,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:15:02.026124687Z [2024-02-23 04:15:02,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:02.028689562Z [2024-02-23 04:15:02,028: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:15:02.034520016Z [2024-02-23 04:15:02,032: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:02.049384969Z [2024-02-23 04:15:02,049: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:02.051710139Z [2024-02-23 04:15:02,051: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:15:02.055421151Z [2024-02-23 04:15:02,055: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:15:02.055636274Z [2024-02-23 04:15:02,055: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:15:02.055841291Z [2024-02-23 04:15:02,055: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:15:02.055967368Z [2024-02-23 04:15:02,055: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:15:02.056275172Z [2024-02-23 04:15:02,056: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:15:02.056417784Z [2024-02-23 04:15:02,056: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:15:02.076712513Z [2024-02-23 04:15:02,076: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:15:02.080372364Z [2024-02-23 04:15:02,080: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:15:02.080483381Z [2024-02-23 04:15:02,080: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:15:02.080701133Z [2024-02-23 04:15:02,080: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:15:02.080825717Z [2024-02-23 04:15:02,080: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:15:02.081154533Z [2024-02-23 04:15:02,081: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:15:02.081345739Z [2024-02-23 04:15:02,081: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:15:02.167817533Z [2024-02-23 04:15:02,167: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:02.174127391Z [2024-02-23 04:15:02,173: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:02.666226505Z [2024-02-23 04:15:02,665: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec2f90fb-400a-4c71-8f68-7648442d9007] succeeded in 2.3584856769994076s: None 2024-02-23T04:15:03.139722892Z [2024-02-23 04:15:03,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe609833-8cc3-4462-b187-6c5e0a6d5559] received 2024-02-23T04:15:03.147943910Z [2024-02-23 04:15:03,147: INFO/ForkPoolWorker-16] [fe609833-8cc3-4462-b187-6c5e0a6d5559] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:15:03.447900483Z [2024-02-23 04:15:03,444: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:15:03.766475834Z [2024-02-23 04:15:03,765: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5794c9d-f2c5-4c33-b465-9b7013d1f3bb] succeeded in 3.4681696340012422s: None 2024-02-23T04:15:04.063734555Z [2024-02-23 04:15:04,063: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e7106ea-fcb2-459c-97c1-f468914faca2] succeeded in 3.751609816998098s: None 2024-02-23T04:15:04.598633560Z [2024-02-23 04:15:04,598: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:15:04.601723302Z [2024-02-23 04:15:04,601: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:04.617603592Z [2024-02-23 04:15:04,617: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:15:04.618856742Z [2024-02-23 04:15:04,618: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:15:04.618873813Z [2024-02-23 04:15:04,618: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:15:04.619040675Z [2024-02-23 04:15:04,618: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:15:04.619053116Z [2024-02-23 04:15:04,618: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:15:04.619369817Z [2024-02-23 04:15:04,619: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:15:04.619386287Z [2024-02-23 04:15:04,619: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:15:04.716434031Z [2024-02-23 04:15:04,708: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:05.424687413Z [2024-02-23 04:15:05,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe609833-8cc3-4462-b187-6c5e0a6d5559] succeeded in 2.283044275998691s: None 2024-02-23T04:15:05.638539409Z [2024-02-23 04:15:05,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[479e856f-521b-44f7-9d5d-c1509b597554] received 2024-02-23T04:15:05.665747481Z [2024-02-23 04:15:05,665: INFO/ForkPoolWorker-15] [479e856f-521b-44f7-9d5d-c1509b597554] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:15:06.026629531Z [2024-02-23 04:15:06,023: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:15:07.182925577Z [2024-02-23 04:15:07,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:15:07.186470965Z [2024-02-23 04:15:07,185: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:07.208373978Z [2024-02-23 04:15:07,208: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:15:07.209925524Z [2024-02-23 04:15:07,209: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:15:07.210483705Z [2024-02-23 04:15:07,210: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:15:07.210763219Z [2024-02-23 04:15:07,210: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:15:07.210972008Z [2024-02-23 04:15:07,210: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:15:07.211313852Z [2024-02-23 04:15:07,211: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:15:07.211473104Z [2024-02-23 04:15:07,211: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:15:07.305631897Z [2024-02-23 04:15:07,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:07.770351263Z [2024-02-23 04:15:07,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dbfb4b7-fa50-4bae-bca8-289111759d74] received 2024-02-23T04:15:07.779495506Z [2024-02-23 04:15:07,779: INFO/ForkPoolWorker-16] [1dbfb4b7-fa50-4bae-bca8-289111759d74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:15:07.855347083Z [2024-02-23 04:15:07,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[479e856f-521b-44f7-9d5d-c1509b597554] succeeded in 2.205156407002505s: None 2024-02-23T04:15:08.174759268Z [2024-02-23 04:15:08,171: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:15:09.295563433Z [2024-02-23 04:15:09,295: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:15:09.299083019Z [2024-02-23 04:15:09,298: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:15:09.336988389Z [2024-02-23 04:15:09,336: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:15:09.338494959Z [2024-02-23 04:15:09,338: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:15:09.338572409Z [2024-02-23 04:15:09,338: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:15:09.338718832Z [2024-02-23 04:15:09,338: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:15:09.338885104Z [2024-02-23 04:15:09,338: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:15:09.339181792Z [2024-02-23 04:15:09,339: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:15:09.339315638Z [2024-02-23 04:15:09,339: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:15:09.430798410Z [2024-02-23 04:15:09,430: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:15:10.047154107Z [2024-02-23 04:15:10,046: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1dbfb4b7-fa50-4bae-bca8-289111759d74] succeeded in 2.274572327001806s: None 2024-02-23T04:16:00.224222901Z [2024-02-23 04:16:00,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c37edfeb-a209-4100-bd98-4aba2a90e0e9] received 2024-02-23T04:16:00.225789884Z [2024-02-23 04:16:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e200397-e3a3-4396-8bcc-f1655162bd4f] received 2024-02-23T04:16:00.227540585Z [2024-02-23 04:16:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29f4d97d-6910-42ed-9c6b-3524a284a4be] received 2024-02-23T04:16:00.229093543Z [2024-02-23 04:16:00,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d1d7f8a-0064-4a6c-ba2a-895eb540971d] received 2024-02-23T04:16:00.235640691Z [2024-02-23 04:16:00,235: INFO/ForkPoolWorker-2] [6d1d7f8a-0064-4a6c-ba2a-895eb540971d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:16:00.241530555Z [2024-02-23 04:16:00,241: INFO/ForkPoolWorker-16] [1e200397-e3a3-4396-8bcc-f1655162bd4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:16:00.242808453Z [2024-02-23 04:16:00,242: INFO/ForkPoolWorker-1] [29f4d97d-6910-42ed-9c6b-3524a284a4be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:16:00.243563093Z [2024-02-23 04:16:00,240: INFO/ForkPoolWorker-15] [c37edfeb-a209-4100-bd98-4aba2a90e0e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:16:00.550378271Z [2024-02-23 04:16:00,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:16:00.581148232Z [2024-02-23 04:16:00,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:16:00.603740594Z [2024-02-23 04:16:00,598: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:16:00.616420954Z [2024-02-23 04:16:00,613: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:16:00.833896914Z [2024-02-23 04:16:00,833: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:16:00.839507594Z [2024-02-23 04:16:00,839: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:16:00.865759867Z [2024-02-23 04:16:00,865: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:16:00.866783129Z [2024-02-23 04:16:00,866: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:16:00.866934231Z [2024-02-23 04:16:00,866: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:16:00.867019028Z [2024-02-23 04:16:00,866: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:16:00.867665164Z [2024-02-23 04:16:00,867: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:16:00.962578122Z [2024-02-23 04:16:00,962: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:16:00.988102568Z [2024-02-23 04:16:00,987: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:16:01.601045597Z [2024-02-23 04:16:01,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c37edfeb-a209-4100-bd98-4aba2a90e0e9] succeeded in 1.374815243001649s: None 2024-02-23T04:16:01.664206293Z [2024-02-23 04:16:01,663: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29f4d97d-6910-42ed-9c6b-3524a284a4be] succeeded in 1.4332981170009589s: None 2024-02-23T04:16:01.814358813Z [2024-02-23 04:16:01,813: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:16:01.818471558Z [2024-02-23 04:16:01,817: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:16:01.841347412Z [2024-02-23 04:16:01,841: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:16:01.843870766Z [2024-02-23 04:16:01,843: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:16:01.844090440Z [2024-02-23 04:16:01,843: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:16:01.844306370Z [2024-02-23 04:16:01,844: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:16:01.844423946Z [2024-02-23 04:16:01,844: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:16:01.844782719Z [2024-02-23 04:16:01,844: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:16:01.844914620Z [2024-02-23 04:16:01,844: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:16:01.853122647Z [2024-02-23 04:16:01,852: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:16:01.856393397Z [2024-02-23 04:16:01,855: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:16:01.875277992Z [2024-02-23 04:16:01,875: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:16:01.876515091Z [2024-02-23 04:16:01,876: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:16:01.876534470Z [2024-02-23 04:16:01,876: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:16:01.876683029Z [2024-02-23 04:16:01,876: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:16:01.876736658Z [2024-02-23 04:16:01,876: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:16:01.876979050Z [2024-02-23 04:16:01,876: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:16:01.877051060Z [2024-02-23 04:16:01,876: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:16:01.921050702Z [2024-02-23 04:16:01,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:16:01.977515269Z [2024-02-23 04:16:01,977: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:16:03.466029478Z [2024-02-23 04:16:03,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e200397-e3a3-4396-8bcc-f1655162bd4f] succeeded in 3.236301254000864s: None 2024-02-23T04:16:03.859682138Z [2024-02-23 04:16:03,859: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6d1d7f8a-0064-4a6c-ba2a-895eb540971d] succeeded in 3.6291668960002426s: None 2024-02-23T04:17:01.148412718Z [2024-02-23 04:17:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdb229a5-2bff-4899-8d0b-11fdbaf9165a] received 2024-02-23T04:17:01.149956894Z [2024-02-23 04:17:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02459d5b-8a7a-40e5-9a05-3438799aa826] received 2024-02-23T04:17:01.157856054Z [2024-02-23 04:17:01,157: INFO/ForkPoolWorker-16] [02459d5b-8a7a-40e5-9a05-3438799aa826] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:17:01.160134898Z [2024-02-23 04:17:01,159: INFO/ForkPoolWorker-15] [bdb229a5-2bff-4899-8d0b-11fdbaf9165a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:17:01.163804471Z [2024-02-23 04:17:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ce53dd8-9bdf-486c-9ffe-5dd5b9ca76d2] received 2024-02-23T04:17:01.171401025Z [2024-02-23 04:17:01,171: INFO/ForkPoolWorker-1] [0ce53dd8-9bdf-486c-9ffe-5dd5b9ca76d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:17:01.477835468Z [2024-02-23 04:17:01,474: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:17:01.483546145Z [2024-02-23 04:17:01,480: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:17:01.493697026Z [2024-02-23 04:17:01,490: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:17:01.705074903Z [2024-02-23 04:17:01,704: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:17:01.709943486Z [2024-02-23 04:17:01,709: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:17:01.740754006Z [2024-02-23 04:17:01,740: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:17:01.742518618Z [2024-02-23 04:17:01,742: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:17:01.742803170Z [2024-02-23 04:17:01,742: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:17:01.743059939Z [2024-02-23 04:17:01,742: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:17:01.743421895Z [2024-02-23 04:17:01,743: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:17:01.882955455Z [2024-02-23 04:17:01,882: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:17:02.600039560Z [2024-02-23 04:17:02,599: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ce53dd8-9bdf-486c-9ffe-5dd5b9ca76d2] succeeded in 1.43419031999656s: None 2024-02-23T04:17:02.730288776Z [2024-02-23 04:17:02,729: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:17:02.733551089Z [2024-02-23 04:17:02,733: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:17:02.773479737Z [2024-02-23 04:17:02,773: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:17:02.775257374Z [2024-02-23 04:17:02,774: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:17:02.775280771Z [2024-02-23 04:17:02,775: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:17:02.775497840Z [2024-02-23 04:17:02,775: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:17:02.775559543Z [2024-02-23 04:17:02,775: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:17:02.776071161Z [2024-02-23 04:17:02,775: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:17:02.776252038Z [2024-02-23 04:17:02,776: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:17:02.789055388Z [2024-02-23 04:17:02,788: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:17:02.792641482Z [2024-02-23 04:17:02,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:17:02.813704740Z [2024-02-23 04:17:02,813: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:17:02.815440807Z [2024-02-23 04:17:02,815: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:17:02.815465621Z [2024-02-23 04:17:02,815: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:17:02.815898684Z [2024-02-23 04:17:02,815: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:17:02.816074792Z [2024-02-23 04:17:02,815: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:17:02.816444224Z [2024-02-23 04:17:02,816: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:17:02.816575571Z [2024-02-23 04:17:02,816: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:17:02.882167234Z [2024-02-23 04:17:02,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:17:02.940560295Z [2024-02-23 04:17:02,940: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:17:05.057861805Z [2024-02-23 04:17:05,057: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bdb229a5-2bff-4899-8d0b-11fdbaf9165a] succeeded in 3.9065134480006236s: None 2024-02-23T04:17:05.736006132Z [2024-02-23 04:17:05,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02459d5b-8a7a-40e5-9a05-3438799aa826] succeeded in 4.58453074299905s: None 2024-02-23T04:17:38.488740887Z [2024-02-23 04:17:38,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5641bfc2-64b7-4815-8e76-c77d702a5a1a] received 2024-02-23T04:17:38.496926006Z [2024-02-23 04:17:38,496: INFO/ForkPoolWorker-15] [5641bfc2-64b7-4815-8e76-c77d702a5a1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223041737_737991', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:17:38.772577377Z [2024-02-23 04:17:38,769: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:17:39.090050638Z [2024-02-23 04:17:39,089: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:17:39.656916607Z [2024-02-23 04:17:39,656: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5641bfc2-64b7-4815-8e76-c77d702a5a1a] succeeded in 1.1658051979975426s: None 2024-02-23T04:18:00.965728423Z [2024-02-23 04:18:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f728ebc-73d8-407a-a178-e9467cfef9d3] received 2024-02-23T04:18:00.970604870Z [2024-02-23 04:18:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e9d9eea-c4b5-4421-b855-e1665bb7e1f3] received 2024-02-23T04:18:00.974292564Z [2024-02-23 04:18:00,973: INFO/ForkPoolWorker-15] [3f728ebc-73d8-407a-a178-e9467cfef9d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:18:00.981855106Z [2024-02-23 04:18:00,981: INFO/ForkPoolWorker-16] [2e9d9eea-c4b5-4421-b855-e1665bb7e1f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:18:00.987561061Z [2024-02-23 04:18:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7a2971d-5a2f-4e1f-a942-a78125e6263f] received 2024-02-23T04:18:00.994455202Z [2024-02-23 04:18:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d86ac80f-b382-4626-bd3f-8d31601f07da] received 2024-02-23T04:18:01.001826161Z [2024-02-23 04:18:01,001: INFO/ForkPoolWorker-1] [b7a2971d-5a2f-4e1f-a942-a78125e6263f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:18:01.010238704Z [2024-02-23 04:18:01,009: INFO/ForkPoolWorker-2] [d86ac80f-b382-4626-bd3f-8d31601f07da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:18:01.348038488Z [2024-02-23 04:18:01,344: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:18:01.410910080Z [2024-02-23 04:18:01,407: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:18:01.526988634Z [2024-02-23 04:18:01,522: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:18:01.595132467Z [2024-02-23 04:18:01,594: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:18:01.599819382Z [2024-02-23 04:18:01,599: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:18:01.616209126Z [2024-02-23 04:18:01,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:18:01.625599976Z [2024-02-23 04:18:01,625: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:18:01.627026289Z [2024-02-23 04:18:01,626: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:18:01.627355791Z [2024-02-23 04:18:01,627: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:18:01.627906568Z [2024-02-23 04:18:01,627: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:18:01.628160310Z [2024-02-23 04:18:01,628: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:18:01.715594762Z [2024-02-23 04:18:01,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:18:01.910592441Z [2024-02-23 04:18:01,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:18:02.308652449Z [2024-02-23 04:18:02,308: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b7a2971d-5a2f-4e1f-a942-a78125e6263f] succeeded in 1.317916885996965s: None 2024-02-23T04:18:02.560672403Z [2024-02-23 04:18:02,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f728ebc-73d8-407a-a178-e9467cfef9d3] succeeded in 1.5921096679994662s: None 2024-02-23T04:18:02.720681355Z [2024-02-23 04:18:02,720: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:18:02.724072137Z [2024-02-23 04:18:02,723: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:18:02.754385064Z [2024-02-23 04:18:02,754: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:18:02.757670750Z [2024-02-23 04:18:02,757: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:18:02.759268308Z [2024-02-23 04:18:02,759: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:18:02.759402775Z [2024-02-23 04:18:02,759: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:18:02.759460107Z [2024-02-23 04:18:02,759: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:18:02.760531322Z [2024-02-23 04:18:02,760: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:18:02.760600684Z [2024-02-23 04:18:02,760: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:18:02.859414200Z [2024-02-23 04:18:02,859: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:18:02.938643514Z [2024-02-23 04:18:02,938: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:18:02.942066555Z [2024-02-23 04:18:02,941: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:18:02.972199968Z [2024-02-23 04:18:02,971: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:18:02.973406763Z [2024-02-23 04:18:02,973: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:18:02.973424365Z [2024-02-23 04:18:02,973: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:18:02.973723239Z [2024-02-23 04:18:02,973: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:18:02.973751202Z [2024-02-23 04:18:02,973: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:18:02.974135819Z [2024-02-23 04:18:02,973: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:18:02.974262993Z [2024-02-23 04:18:02,974: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:18:03.064807381Z [2024-02-23 04:18:03,064: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:18:05.481839968Z [2024-02-23 04:18:05,481: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e9d9eea-c4b5-4421-b855-e1665bb7e1f3] succeeded in 4.507261810998898s: None 2024-02-23T04:18:06.710567410Z [2024-02-23 04:18:06,710: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d86ac80f-b382-4626-bd3f-8d31601f07da] succeeded in 5.714101841000229s: None 2024-02-23T04:19:00.418984487Z [2024-02-23 04:19:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f0e2638-b450-4005-8861-5708a8ae8b16] received 2024-02-23T04:19:00.425906487Z [2024-02-23 04:19:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44b1adfa-a842-4fa4-a4d0-bcad337e27e9] received 2024-02-23T04:19:00.434668289Z [2024-02-23 04:19:00,434: INFO/ForkPoolWorker-15] [8f0e2638-b450-4005-8861-5708a8ae8b16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:19:00.436775231Z [2024-02-23 04:19:00,436: INFO/ForkPoolWorker-16] [44b1adfa-a842-4fa4-a4d0-bcad337e27e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:19:00.442695066Z [2024-02-23 04:19:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52617367-6972-46f4-b487-e570f8ef0a94] received 2024-02-23T04:19:00.455059377Z [2024-02-23 04:19:00,454: INFO/ForkPoolWorker-1] [52617367-6972-46f4-b487-e570f8ef0a94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:19:00.799683553Z [2024-02-23 04:19:00,796: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:19:00.822988506Z [2024-02-23 04:19:00,819: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:19:00.871685931Z [2024-02-23 04:19:00,868: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:19:01.038589082Z [2024-02-23 04:19:01,038: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:19:01.043308256Z [2024-02-23 04:19:01,042: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:19:01.067725838Z [2024-02-23 04:19:01,067: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:19:01.068894507Z [2024-02-23 04:19:01,068: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:19:01.069076237Z [2024-02-23 04:19:01,068: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:19:01.069212557Z [2024-02-23 04:19:01,069: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:19:01.069449100Z [2024-02-23 04:19:01,069: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:19:01.158727501Z [2024-02-23 04:19:01,158: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:19:01.741268383Z [2024-02-23 04:19:01,740: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44b1adfa-a842-4fa4-a4d0-bcad337e27e9] succeeded in 1.3122553210014303s: None 2024-02-23T04:19:01.948105643Z [2024-02-23 04:19:01,947: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:19:01.951323786Z [2024-02-23 04:19:01,950: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:19:01.972025770Z [2024-02-23 04:19:01,971: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:19:01.973387453Z [2024-02-23 04:19:01,973: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:19:01.973574652Z [2024-02-23 04:19:01,973: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:19:01.973682902Z [2024-02-23 04:19:01,973: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:19:01.973769569Z [2024-02-23 04:19:01,973: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:19:01.974009047Z [2024-02-23 04:19:01,973: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:19:01.974468203Z [2024-02-23 04:19:01,973: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:19:02.073135922Z [2024-02-23 04:19:02,072: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:19:02.112666207Z [2024-02-23 04:19:02,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:19:02.116034329Z [2024-02-23 04:19:02,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:19:02.149201248Z [2024-02-23 04:19:02,148: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:19:02.152713857Z [2024-02-23 04:19:02,152: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:19:02.153061859Z [2024-02-23 04:19:02,152: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:19:02.153574722Z [2024-02-23 04:19:02,153: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:19:02.154119477Z [2024-02-23 04:19:02,153: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:19:02.154864724Z [2024-02-23 04:19:02,154: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:19:02.155773080Z [2024-02-23 04:19:02,155: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:19:02.266573445Z [2024-02-23 04:19:02,266: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:19:04.437773243Z [2024-02-23 04:19:04,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f0e2638-b450-4005-8861-5708a8ae8b16] succeeded in 4.013458260000334s: None 2024-02-23T04:19:04.677945721Z [2024-02-23 04:19:04,677: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52617367-6972-46f4-b487-e570f8ef0a94] succeeded in 4.233017536000261s: None 2024-02-23T04:20:00.927092953Z [2024-02-23 04:20:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eabe5d3-b1a3-4a08-ab7b-5de8969860a8] received 2024-02-23T04:20:00.930551364Z [2024-02-23 04:20:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19d8239b-7ac6-43a0-9951-8f02396b2c15] received 2024-02-23T04:20:00.934923938Z [2024-02-23 04:20:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78ee3348-71c5-43c8-b917-7d0ce4bdf550] received 2024-02-23T04:20:00.937315053Z [2024-02-23 04:20:00,937: INFO/ForkPoolWorker-15] [5eabe5d3-b1a3-4a08-ab7b-5de8969860a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:20:00.939697355Z [2024-02-23 04:20:00,939: INFO/ForkPoolWorker-16] [19d8239b-7ac6-43a0-9951-8f02396b2c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:20:00.946115371Z [2024-02-23 04:20:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7876364e-285b-40db-b499-3e973b70d9a1] received 2024-02-23T04:20:00.947896921Z [2024-02-23 04:20:00,946: INFO/ForkPoolWorker-1] [78ee3348-71c5-43c8-b917-7d0ce4bdf550] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:20:00.956566951Z [2024-02-23 04:20:00,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[139678df-67a9-4173-b5c6-3737ed32df8d] received 2024-02-23T04:20:00.979800168Z [2024-02-23 04:20:00,979: INFO/ForkPoolWorker-2] [7876364e-285b-40db-b499-3e973b70d9a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:20:00.982547078Z [2024-02-23 04:20:00,982: INFO/ForkPoolWorker-3] [139678df-67a9-4173-b5c6-3737ed32df8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:20:01.353992592Z [2024-02-23 04:20:01,350: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:20:01.379726399Z [2024-02-23 04:20:01,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:20:01.449883791Z [2024-02-23 04:20:01,438: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:20:01.482689673Z [2024-02-23 04:20:01,478: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:20:01.514732465Z [2024-02-23 04:20:01,497: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:20:01.644155077Z [2024-02-23 04:20:01,643: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T04:20:01.648327021Z [2024-02-23 04:20:01,647: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:01.676268778Z [2024-02-23 04:20:01,675: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T04:20:01.678731211Z [2024-02-23 04:20:01,678: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:20:01.680006315Z [2024-02-23 04:20:01,678: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:20:01.680094180Z [2024-02-23 04:20:01,679: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T04:20:01.680362743Z [2024-02-23 04:20:01,680: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:20:01.787418995Z [2024-02-23 04:20:01,787: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:02.103377917Z [2024-02-23 04:20:02,103: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:02.460921733Z [2024-02-23 04:20:02,457: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[139678df-67a9-4173-b5c6-3737ed32df8d] succeeded in 1.4938944910027203s: None 2024-02-23T04:20:02.727005650Z [2024-02-23 04:20:02,726: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78ee3348-71c5-43c8-b917-7d0ce4bdf550] succeeded in 1.7886324120008794s: None 2024-02-23T04:20:02.922852930Z [2024-02-23 04:20:02,922: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:20:02.926136118Z [2024-02-23 04:20:02,925: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:02.946981028Z [2024-02-23 04:20:02,946: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:20:02.948466929Z [2024-02-23 04:20:02,948: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:20:02.948484090Z [2024-02-23 04:20:02,948: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:20:02.948616425Z [2024-02-23 04:20:02,948: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:20:02.948754487Z [2024-02-23 04:20:02,948: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:20:02.948884748Z [2024-02-23 04:20:02,948: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:20:02.948912909Z [2024-02-23 04:20:02,948: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:20:03.052822452Z [2024-02-23 04:20:03,052: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:03.104153379Z [2024-02-23 04:20:03,103: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:20:03.107581929Z [2024-02-23 04:20:03,107: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:03.129351572Z [2024-02-23 04:20:03,129: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:20:03.130685011Z [2024-02-23 04:20:03,130: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:20:03.130699197Z [2024-02-23 04:20:03,130: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:20:03.130869725Z [2024-02-23 04:20:03,130: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:20:03.130968575Z [2024-02-23 04:20:03,130: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:20:03.131989157Z [2024-02-23 04:20:03,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:20:03.132274783Z [2024-02-23 04:20:03,132: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:20:03.162934239Z [2024-02-23 04:20:03,162: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:20:03.167055949Z [2024-02-23 04:20:03,166: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:03.203875345Z [2024-02-23 04:20:03,203: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:20:03.205394144Z [2024-02-23 04:20:03,205: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:20:03.205466070Z [2024-02-23 04:20:03,205: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:20:03.205580808Z [2024-02-23 04:20:03,205: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:20:03.205642773Z [2024-02-23 04:20:03,205: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:20:03.205911195Z [2024-02-23 04:20:03,205: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:20:03.205928841Z [2024-02-23 04:20:03,205: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:20:03.231893998Z [2024-02-23 04:20:03,231: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:03.296705812Z [2024-02-23 04:20:03,296: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:03.934097723Z [2024-02-23 04:20:03,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5eabe5d3-b1a3-4a08-ab7b-5de8969860a8] succeeded in 3.002426678001939s: None 2024-02-23T04:20:04.719117933Z [2024-02-23 04:20:04,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d004630-1376-4739-a767-633624e9dd91] received 2024-02-23T04:20:04.728409415Z [2024-02-23 04:20:04,724: INFO/ForkPoolWorker-15] [9d004630-1376-4739-a767-633624e9dd91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:20:04.896601607Z [2024-02-23 04:20:04,896: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19d8239b-7ac6-43a0-9951-8f02396b2c15] succeeded in 3.9645678340020822s: None 2024-02-23T04:20:04.952168961Z [2024-02-23 04:20:04,951: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7876364e-285b-40db-b499-3e973b70d9a1] succeeded in 3.9943018240010133s: None 2024-02-23T04:20:05.068890927Z [2024-02-23 04:20:05,065: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:20:06.232392522Z [2024-02-23 04:20:06,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:20:06.235605122Z [2024-02-23 04:20:06,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:06.260743204Z [2024-02-23 04:20:06,260: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:20:06.262444369Z [2024-02-23 04:20:06,262: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:20:06.262464171Z [2024-02-23 04:20:06,262: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:20:06.262669530Z [2024-02-23 04:20:06,262: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:20:06.262682923Z [2024-02-23 04:20:06,262: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:20:06.263377259Z [2024-02-23 04:20:06,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:20:06.263398737Z [2024-02-23 04:20:06,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:20:06.362295731Z [2024-02-23 04:20:06,361: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:07.064444471Z [2024-02-23 04:20:07,063: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d004630-1376-4739-a767-633624e9dd91] succeeded in 2.3542510959996434s: None 2024-02-23T04:20:07.216514114Z [2024-02-23 04:20:07,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39ae1ef6-44f1-4698-a2c2-412c2b8a0eb7] received 2024-02-23T04:20:07.226088701Z [2024-02-23 04:20:07,225: INFO/ForkPoolWorker-15] [39ae1ef6-44f1-4698-a2c2-412c2b8a0eb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:20:07.552445374Z [2024-02-23 04:20:07,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:20:08.757101046Z [2024-02-23 04:20:08,756: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:20:08.759982629Z [2024-02-23 04:20:08,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:08.786788543Z [2024-02-23 04:20:08,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:20:08.788051536Z [2024-02-23 04:20:08,787: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:20:08.788072974Z [2024-02-23 04:20:08,787: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:20:08.788193479Z [2024-02-23 04:20:08,788: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:20:08.788214225Z [2024-02-23 04:20:08,788: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:20:08.788455964Z [2024-02-23 04:20:08,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:20:08.788477167Z [2024-02-23 04:20:08,788: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:20:08.921344507Z [2024-02-23 04:20:08,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:09.554923319Z [2024-02-23 04:20:09,554: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39ae1ef6-44f1-4698-a2c2-412c2b8a0eb7] succeeded in 2.3346589239990863s: None 2024-02-23T04:20:09.739363740Z [2024-02-23 04:20:09,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e252ca2b-f56a-4bbe-b9dd-7d2ff6967535] received 2024-02-23T04:20:09.759781538Z [2024-02-23 04:20:09,759: INFO/ForkPoolWorker-15] [e252ca2b-f56a-4bbe-b9dd-7d2ff6967535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:20:10.137225026Z [2024-02-23 04:20:10,132: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:20:11.242693038Z [2024-02-23 04:20:11,242: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:20:11.245844917Z [2024-02-23 04:20:11,245: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:20:11.280614331Z [2024-02-23 04:20:11,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:20:11.281934517Z [2024-02-23 04:20:11,281: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:20:11.282012508Z [2024-02-23 04:20:11,281: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:20:11.282231417Z [2024-02-23 04:20:11,282: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:20:11.282345430Z [2024-02-23 04:20:11,282: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:20:11.282621391Z [2024-02-23 04:20:11,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:20:11.282756560Z [2024-02-23 04:20:11,282: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:20:11.395491530Z [2024-02-23 04:20:11,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:20:11.980856032Z [2024-02-23 04:20:11,980: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e252ca2b-f56a-4bbe-b9dd-7d2ff6967535] succeeded in 2.23186113599877s: None 2024-02-23T04:21:00.368698452Z [2024-02-23 04:21:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d7e974b-9b1d-4f88-957b-58fbc5785e37] received 2024-02-23T04:21:00.373388879Z [2024-02-23 04:21:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a903a86-4348-427f-badd-63b850a940ac] received 2024-02-23T04:21:00.379975041Z [2024-02-23 04:21:00,379: INFO/ForkPoolWorker-16] [2a903a86-4348-427f-badd-63b850a940ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:21:00.384161075Z [2024-02-23 04:21:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1a4e689-39a4-4f59-813b-74121a67c1ef] received 2024-02-23T04:21:00.388946188Z [2024-02-23 04:21:00,388: INFO/ForkPoolWorker-15] [0d7e974b-9b1d-4f88-957b-58fbc5785e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:21:00.390872480Z [2024-02-23 04:21:00,390: INFO/ForkPoolWorker-1] [f1a4e689-39a4-4f59-813b-74121a67c1ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:21:00.678210012Z [2024-02-23 04:21:00,674: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:21:00.768946078Z [2024-02-23 04:21:00,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:21:00.773124714Z [2024-02-23 04:21:00,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:21:00.943078635Z [2024-02-23 04:21:00,942: INFO/ForkPoolWorker-15] Getting SDNC list 2024-02-23T04:21:00.947356579Z [2024-02-23 04:21:00,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:21:00.971618636Z [2024-02-23 04:21:00,971: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:21:00.973534324Z [2024-02-23 04:21:00,973: INFO/ForkPoolWorker-15] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:21:00.973698849Z [2024-02-23 04:21:00,973: INFO/ForkPoolWorker-15] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:21:00.973822267Z [2024-02-23 04:21:00,973: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-02-23T04:21:00.974111449Z [2024-02-23 04:21:00,973: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:21:01.056596991Z [2024-02-23 04:21:01,056: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:21:01.678009333Z [2024-02-23 04:21:01,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d7e974b-9b1d-4f88-957b-58fbc5785e37] succeeded in 1.3037006500017014s: None 2024-02-23T04:21:01.938926196Z [2024-02-23 04:21:01,938: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:21:01.942267486Z [2024-02-23 04:21:01,941: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:21:01.964273792Z [2024-02-23 04:21:01,964: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:21:01.965500602Z [2024-02-23 04:21:01,965: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:21:01.965599802Z [2024-02-23 04:21:01,965: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:21:01.965762945Z [2024-02-23 04:21:01,965: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:21:01.965838310Z [2024-02-23 04:21:01,965: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:21:01.966161067Z [2024-02-23 04:21:01,965: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:21:01.966175216Z [2024-02-23 04:21:01,966: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:21:02.064015942Z [2024-02-23 04:21:02,063: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:21:02.218617255Z [2024-02-23 04:21:02,218: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:21:02.222346084Z [2024-02-23 04:21:02,221: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:21:02.243891740Z [2024-02-23 04:21:02,243: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:21:02.245422924Z [2024-02-23 04:21:02,245: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:21:02.245440722Z [2024-02-23 04:21:02,245: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:21:02.245633880Z [2024-02-23 04:21:02,245: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:21:02.245708478Z [2024-02-23 04:21:02,245: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:21:02.246043658Z [2024-02-23 04:21:02,245: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:21:02.246100805Z [2024-02-23 04:21:02,245: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:21:02.367795965Z [2024-02-23 04:21:02,367: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:21:03.645624575Z [2024-02-23 04:21:03,645: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a903a86-4348-427f-badd-63b850a940ac] succeeded in 3.2708162189992436s: None 2024-02-23T04:21:04.409454742Z [2024-02-23 04:21:04,408: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1a4e689-39a4-4f59-813b-74121a67c1ef] succeeded in 4.02379782099888s: None 2024-02-23T04:22:00.681036003Z [2024-02-23 04:22:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be29e8fc-eafb-4dc0-92a1-4cb3bba9aff0] received 2024-02-23T04:22:00.686787093Z [2024-02-23 04:22:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1da31534-bfc5-4e09-88bd-6a47daa64f2e] received 2024-02-23T04:22:00.689289631Z [2024-02-23 04:22:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d458fcfe-a19c-4531-a64d-991092393200] received 2024-02-23T04:22:00.689934498Z [2024-02-23 04:22:00,689: INFO/ForkPoolWorker-15] [be29e8fc-eafb-4dc0-92a1-4cb3bba9aff0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:22:00.694413013Z [2024-02-23 04:22:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2314a326-aaf1-4ece-9ee2-6a57d15e9b5d] received 2024-02-23T04:22:00.699487854Z [2024-02-23 04:22:00,699: INFO/ForkPoolWorker-1] [d458fcfe-a19c-4531-a64d-991092393200] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:22:00.706311304Z [2024-02-23 04:22:00,706: INFO/ForkPoolWorker-2] [2314a326-aaf1-4ece-9ee2-6a57d15e9b5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:22:00.711546759Z [2024-02-23 04:22:00,711: INFO/ForkPoolWorker-16] [1da31534-bfc5-4e09-88bd-6a47daa64f2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:22:01.057668630Z [2024-02-23 04:22:01,047: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:22:01.226636962Z [2024-02-23 04:22:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:22:01.266273311Z [2024-02-23 04:22:01,262: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:22:01.324397279Z [2024-02-23 04:22:01,321: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:22:01.520920741Z [2024-02-23 04:22:01,520: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:22:01.524857867Z [2024-02-23 04:22:01,524: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:22:01.580649221Z [2024-02-23 04:22:01,580: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:22:01.584062634Z [2024-02-23 04:22:01,583: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:22:01.584364604Z [2024-02-23 04:22:01,584: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:22:01.584547469Z [2024-02-23 04:22:01,584: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:22:01.584872293Z [2024-02-23 04:22:01,584: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:22:01.691586553Z [2024-02-23 04:22:01,691: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:22:01.766499446Z [2024-02-23 04:22:01,766: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:22:02.478909969Z [2024-02-23 04:22:02,478: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d458fcfe-a19c-4531-a64d-991092393200] succeeded in 1.7872180170015781s: None 2024-02-23T04:22:02.607343211Z [2024-02-23 04:22:02,606: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1da31534-bfc5-4e09-88bd-6a47daa64f2e] succeeded in 1.9171723850013223s: None 2024-02-23T04:22:02.691947457Z [2024-02-23 04:22:02,691: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:22:02.695253346Z [2024-02-23 04:22:02,694: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:22:02.720498421Z [2024-02-23 04:22:02,720: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:22:02.721946777Z [2024-02-23 04:22:02,721: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:22:02.722038532Z [2024-02-23 04:22:02,721: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:22:02.722236696Z [2024-02-23 04:22:02,721: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:22:02.722321802Z [2024-02-23 04:22:02,722: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:22:02.722700679Z [2024-02-23 04:22:02,722: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:22:02.722713880Z [2024-02-23 04:22:02,722: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:22:02.828665506Z [2024-02-23 04:22:02,828: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:22:03.093177630Z [2024-02-23 04:22:03,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:22:03.096686649Z [2024-02-23 04:22:03,096: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:22:03.128725161Z [2024-02-23 04:22:03,128: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:22:03.136930845Z [2024-02-23 04:22:03,136: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:22:03.136981855Z [2024-02-23 04:22:03,136: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:22:03.137274897Z [2024-02-23 04:22:03,136: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:22:03.137518176Z [2024-02-23 04:22:03,137: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:22:03.138113242Z [2024-02-23 04:22:03,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:22:03.138128794Z [2024-02-23 04:22:03,137: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:22:03.234072725Z [2024-02-23 04:22:03,233: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:22:05.488612556Z [2024-02-23 04:22:05,488: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2314a326-aaf1-4ece-9ee2-6a57d15e9b5d] succeeded in 4.791963517000113s: None 2024-02-23T04:22:05.561369642Z [2024-02-23 04:22:05,560: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be29e8fc-eafb-4dc0-92a1-4cb3bba9aff0] succeeded in 4.877169274001062s: None 2024-02-23T04:23:00.301498566Z [2024-02-23 04:23:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590e8adf-9f44-4521-a73a-2a464e270731] received 2024-02-23T04:23:00.308803063Z [2024-02-23 04:23:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fbfa48f-e641-4c4d-9a99-d69085fd366c] received 2024-02-23T04:23:00.317737622Z [2024-02-23 04:23:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4de9958e-5f8a-4a16-82f4-b8daaa93ba79] received 2024-02-23T04:23:00.318292465Z [2024-02-23 04:23:00,318: INFO/ForkPoolWorker-15] [590e8adf-9f44-4521-a73a-2a464e270731] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:23:00.319103248Z [2024-02-23 04:23:00,318: INFO/ForkPoolWorker-16] [4fbfa48f-e641-4c4d-9a99-d69085fd366c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:23:00.335453535Z [2024-02-23 04:23:00,333: INFO/ForkPoolWorker-1] [4de9958e-5f8a-4a16-82f4-b8daaa93ba79] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:23:00.643842723Z [2024-02-23 04:23:00,640: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:23:00.682748888Z [2024-02-23 04:23:00,679: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:23:00.698965067Z [2024-02-23 04:23:00,695: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:23:00.812663761Z [2024-02-23 04:23:00,812: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:23:00.816690633Z [2024-02-23 04:23:00,816: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:23:00.848838067Z [2024-02-23 04:23:00,848: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:23:00.849859740Z [2024-02-23 04:23:00,849: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:23:00.850135726Z [2024-02-23 04:23:00,849: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:23:00.850269995Z [2024-02-23 04:23:00,850: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:23:00.850599520Z [2024-02-23 04:23:00,850: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:23:00.977539851Z [2024-02-23 04:23:00,977: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:23:01.585626015Z [2024-02-23 04:23:01,585: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4de9958e-5f8a-4a16-82f4-b8daaa93ba79] succeeded in 1.263682646000234s: None 2024-02-23T04:23:01.876739868Z [2024-02-23 04:23:01,876: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:23:01.880161916Z [2024-02-23 04:23:01,879: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:23:01.905263314Z [2024-02-23 04:23:01,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:23:01.907162185Z [2024-02-23 04:23:01,906: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:23:01.907206103Z [2024-02-23 04:23:01,907: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:23:01.907450602Z [2024-02-23 04:23:01,907: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:23:01.907521983Z [2024-02-23 04:23:01,907: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:23:01.907912892Z [2024-02-23 04:23:01,907: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:23:01.907977221Z [2024-02-23 04:23:01,907: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:23:01.993497893Z [2024-02-23 04:23:01,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:23:02.009948444Z [2024-02-23 04:23:02,009: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:23:02.013489860Z [2024-02-23 04:23:02,012: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:23:02.045932598Z [2024-02-23 04:23:02,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:23:02.047212970Z [2024-02-23 04:23:02,047: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:23:02.047228655Z [2024-02-23 04:23:02,047: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:23:02.047338450Z [2024-02-23 04:23:02,047: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:23:02.047383998Z [2024-02-23 04:23:02,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:23:02.047690567Z [2024-02-23 04:23:02,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:23:02.048016444Z [2024-02-23 04:23:02,047: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:23:02.126521792Z [2024-02-23 04:23:02,126: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:23:03.903741444Z [2024-02-23 04:23:03,903: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fbfa48f-e641-4c4d-9a99-d69085fd366c] succeeded in 3.5911814290011534s: None 2024-02-23T04:23:04.062891739Z [2024-02-23 04:23:04,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[590e8adf-9f44-4521-a73a-2a464e270731] succeeded in 3.7516844080018927s: None 2024-02-23T04:24:00.346888202Z [2024-02-23 04:24:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4683882e-b83a-4370-bd54-c39d56efef2f] received 2024-02-23T04:24:00.351344447Z [2024-02-23 04:24:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bd539e7-45d9-460a-aa32-8cf9c8712fec] received 2024-02-23T04:24:00.361375783Z [2024-02-23 04:24:00,361: INFO/ForkPoolWorker-15] [4683882e-b83a-4370-bd54-c39d56efef2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:24:00.368896105Z [2024-02-23 04:24:00,368: INFO/ForkPoolWorker-16] [6bd539e7-45d9-460a-aa32-8cf9c8712fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:24:00.371809940Z [2024-02-23 04:24:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb0c0aee-b3e1-4feb-98d7-dc2dc509bf8c] received 2024-02-23T04:24:00.374202076Z [2024-02-23 04:24:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65104cd6-35b0-4570-a4e4-797bbf39c233] received 2024-02-23T04:24:00.388309046Z [2024-02-23 04:24:00,388: INFO/ForkPoolWorker-1] [bb0c0aee-b3e1-4feb-98d7-dc2dc509bf8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:24:00.392312360Z [2024-02-23 04:24:00,392: INFO/ForkPoolWorker-2] [65104cd6-35b0-4570-a4e4-797bbf39c233] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:24:00.688649299Z [2024-02-23 04:24:00,684: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:24:00.691387317Z [2024-02-23 04:24:00,687: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:24:00.717815158Z [2024-02-23 04:24:00,714: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:24:00.727083655Z [2024-02-23 04:24:00,724: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:24:00.869767833Z [2024-02-23 04:24:00,869: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:24:00.874182193Z [2024-02-23 04:24:00,873: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:24:00.937733933Z [2024-02-23 04:24:00,937: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:24:00.938817559Z [2024-02-23 04:24:00,938: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:24:00.939062564Z [2024-02-23 04:24:00,938: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:24:00.939326933Z [2024-02-23 04:24:00,939: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:24:00.939683299Z [2024-02-23 04:24:00,939: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:24:00.969023761Z [2024-02-23 04:24:00,968: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:24:01.080449576Z [2024-02-23 04:24:01,080: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:24:01.631431151Z [2024-02-23 04:24:01,631: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4683882e-b83a-4370-bd54-c39d56efef2f] succeeded in 1.281925561997923s: None 2024-02-23T04:24:01.722203651Z [2024-02-23 04:24:01,721: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[65104cd6-35b0-4570-a4e4-797bbf39c233] succeeded in 1.3419673690004856s: None 2024-02-23T04:24:02.056839803Z [2024-02-23 04:24:02,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:24:02.060122136Z [2024-02-23 04:24:02,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:24:02.089312080Z [2024-02-23 04:24:02,089: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:24:02.090755143Z [2024-02-23 04:24:02,090: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:24:02.090795511Z [2024-02-23 04:24:02,090: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:24:02.091018213Z [2024-02-23 04:24:02,090: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:24:02.091161460Z [2024-02-23 04:24:02,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:24:02.091951248Z [2024-02-23 04:24:02,091: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:24:02.092306619Z [2024-02-23 04:24:02,091: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:24:02.171376671Z [2024-02-23 04:24:02,170: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:24:02.174729099Z [2024-02-23 04:24:02,174: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:24:02.186414299Z [2024-02-23 04:24:02,186: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:24:02.193908453Z [2024-02-23 04:24:02,193: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:24:02.198454122Z [2024-02-23 04:24:02,198: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:24:02.198615040Z [2024-02-23 04:24:02,198: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:24:02.198919502Z [2024-02-23 04:24:02,198: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:24:02.199065431Z [2024-02-23 04:24:02,198: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:24:02.199884029Z [2024-02-23 04:24:02,199: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:24:02.200058339Z [2024-02-23 04:24:02,199: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:24:02.327433459Z [2024-02-23 04:24:02,327: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:24:04.110064697Z [2024-02-23 04:24:04,109: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb0c0aee-b3e1-4feb-98d7-dc2dc509bf8c] succeeded in 3.7357676690007793s: None 2024-02-23T04:24:04.149342085Z [2024-02-23 04:24:04,148: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6bd539e7-45d9-460a-aa32-8cf9c8712fec] succeeded in 3.795248396003444s: None 2024-02-23T04:25:01.346612348Z [2024-02-23 04:25:01,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8843e81b-3c16-4a79-b4cc-c2b6b0eacc0e] received 2024-02-23T04:25:01.349724188Z [2024-02-23 04:25:01,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[283fc092-4130-4a43-a6bb-9ceee7372501] received 2024-02-23T04:25:01.352764435Z [2024-02-23 04:25:01,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05ff1c7a-2921-4da0-aa1d-209948d08c6a] received 2024-02-23T04:25:01.361964000Z [2024-02-23 04:25:01,361: INFO/ForkPoolWorker-16] [283fc092-4130-4a43-a6bb-9ceee7372501] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:25:01.362490280Z [2024-02-23 04:25:01,362: INFO/ForkPoolWorker-15] [8843e81b-3c16-4a79-b4cc-c2b6b0eacc0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:25:01.371659686Z [2024-02-23 04:25:01,371: INFO/ForkPoolWorker-1] [05ff1c7a-2921-4da0-aa1d-209948d08c6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:25:01.377561984Z [2024-02-23 04:25:01,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fd17b9c-b0f8-492e-a173-d4cc8860df15] received 2024-02-23T04:25:01.387650750Z [2024-02-23 04:25:01,387: INFO/ForkPoolWorker-2] [6fd17b9c-b0f8-492e-a173-d4cc8860df15] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:25:01.682515900Z [2024-02-23 04:25:01,679: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:25:01.699767122Z [2024-02-23 04:25:01,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:25:01.745316243Z [2024-02-23 04:25:01,741: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:25:01.811662588Z [2024-02-23 04:25:01,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:25:02.004594923Z [2024-02-23 04:25:02,004: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:25:02.009407283Z [2024-02-23 04:25:02,008: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:02.043090580Z [2024-02-23 04:25:02,042: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:25:02.044635494Z [2024-02-23 04:25:02,044: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:25:02.044787344Z [2024-02-23 04:25:02,044: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:25:02.044882367Z [2024-02-23 04:25:02,044: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:25:02.045773379Z [2024-02-23 04:25:02,045: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:25:02.159943235Z [2024-02-23 04:25:02,159: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:02.803948231Z [2024-02-23 04:25:02,803: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6fd17b9c-b0f8-492e-a173-d4cc8860df15] succeeded in 1.4238767420029035s: None 2024-02-23T04:25:02.852798913Z [2024-02-23 04:25:02,852: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:25:02.856333181Z [2024-02-23 04:25:02,855: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:02.880621261Z [2024-02-23 04:25:02,880: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:25:02.882426716Z [2024-02-23 04:25:02,882: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:25:02.882600878Z [2024-02-23 04:25:02,882: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:25:02.882766767Z [2024-02-23 04:25:02,882: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:25:02.882953640Z [2024-02-23 04:25:02,882: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:25:02.883522886Z [2024-02-23 04:25:02,883: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:25:02.883974830Z [2024-02-23 04:25:02,883: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:25:02.984243984Z [2024-02-23 04:25:02,983: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:03.001445166Z [2024-02-23 04:25:03,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:25:03.004852889Z [2024-02-23 04:25:03,004: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:03.025606801Z [2024-02-23 04:25:03,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:25:03.032471384Z [2024-02-23 04:25:03,032: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:25:03.032526628Z [2024-02-23 04:25:03,032: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:25:03.032764481Z [2024-02-23 04:25:03,032: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:25:03.032872401Z [2024-02-23 04:25:03,032: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:25:03.033237879Z [2024-02-23 04:25:03,033: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:25:03.033381922Z [2024-02-23 04:25:03,033: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:25:03.143260399Z [2024-02-23 04:25:03,142: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:25:03.146706102Z [2024-02-23 04:25:03,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:03.151788460Z [2024-02-23 04:25:03,151: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:03.183670872Z [2024-02-23 04:25:03,183: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:25:03.187629811Z [2024-02-23 04:25:03,187: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:25:03.187649577Z [2024-02-23 04:25:03,187: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:25:03.187764673Z [2024-02-23 04:25:03,187: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:25:03.187771690Z [2024-02-23 04:25:03,187: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:25:03.188009352Z [2024-02-23 04:25:03,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:25:03.188016494Z [2024-02-23 04:25:03,187: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:25:03.279254716Z [2024-02-23 04:25:03,278: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:03.793167040Z [2024-02-23 04:25:03,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8843e81b-3c16-4a79-b4cc-c2b6b0eacc0e] succeeded in 2.4420597400021506s: None 2024-02-23T04:25:03.972042043Z [2024-02-23 04:25:03,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3ad612c-ac12-48f3-8407-3493868f8ca3] received 2024-02-23T04:25:03.984244064Z [2024-02-23 04:25:03,983: INFO/ForkPoolWorker-15] [d3ad612c-ac12-48f3-8407-3493868f8ca3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:25:04.275120694Z [2024-02-23 04:25:04,271: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:25:04.916004939Z [2024-02-23 04:25:04,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[283fc092-4130-4a43-a6bb-9ceee7372501] succeeded in 3.56313670000236s: None 2024-02-23T04:25:05.110906910Z [2024-02-23 04:25:05,110: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05ff1c7a-2921-4da0-aa1d-209948d08c6a] succeeded in 3.752052741998341s: None 2024-02-23T04:25:05.511439256Z [2024-02-23 04:25:05,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:25:05.518679023Z [2024-02-23 04:25:05,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:05.543475798Z [2024-02-23 04:25:05,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:25:05.544839436Z [2024-02-23 04:25:05,544: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:25:05.544886531Z [2024-02-23 04:25:05,544: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:25:05.545104750Z [2024-02-23 04:25:05,544: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:25:05.545171588Z [2024-02-23 04:25:05,545: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:25:05.545895405Z [2024-02-23 04:25:05,545: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:25:05.546029168Z [2024-02-23 04:25:05,545: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:25:05.628399927Z [2024-02-23 04:25:05,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:06.280925392Z [2024-02-23 04:25:06,280: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3ad612c-ac12-48f3-8407-3493868f8ca3] succeeded in 2.305857199997263s: None 2024-02-23T04:25:06.464947765Z [2024-02-23 04:25:06,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e372408-fe6c-4f04-8fda-9751a19ac36f] received 2024-02-23T04:25:06.475326986Z [2024-02-23 04:25:06,475: INFO/ForkPoolWorker-15] [4e372408-fe6c-4f04-8fda-9751a19ac36f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:25:06.795571566Z [2024-02-23 04:25:06,792: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:25:08.022510231Z [2024-02-23 04:25:08,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:25:08.030491186Z [2024-02-23 04:25:08,029: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:08.062233997Z [2024-02-23 04:25:08,061: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:25:08.064108679Z [2024-02-23 04:25:08,063: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:25:08.064140585Z [2024-02-23 04:25:08,063: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:25:08.064308341Z [2024-02-23 04:25:08,063: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:25:08.064315872Z [2024-02-23 04:25:08,064: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:25:08.064944172Z [2024-02-23 04:25:08,064: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:25:08.064956589Z [2024-02-23 04:25:08,064: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:25:08.157396409Z [2024-02-23 04:25:08,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:08.760850306Z [2024-02-23 04:25:08,760: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e372408-fe6c-4f04-8fda-9751a19ac36f] succeeded in 2.2941456509979616s: None 2024-02-23T04:25:08.845553345Z [2024-02-23 04:25:08,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1ce85c8-d820-4a84-ac2e-50a977b609b5] received 2024-02-23T04:25:08.853241611Z [2024-02-23 04:25:08,852: INFO/ForkPoolWorker-15] [c1ce85c8-d820-4a84-ac2e-50a977b609b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:25:09.112916655Z [2024-02-23 04:25:09,109: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:25:10.269832087Z [2024-02-23 04:25:10,269: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:25:10.273017474Z [2024-02-23 04:25:10,272: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:25:10.289999461Z [2024-02-23 04:25:10,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:25:10.291288197Z [2024-02-23 04:25:10,291: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:25:10.291418936Z [2024-02-23 04:25:10,291: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:25:10.291610695Z [2024-02-23 04:25:10,291: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:25:10.291708279Z [2024-02-23 04:25:10,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:25:10.291991279Z [2024-02-23 04:25:10,291: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:25:10.292110807Z [2024-02-23 04:25:10,292: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:25:10.379152427Z [2024-02-23 04:25:10,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:11.046770682Z [2024-02-23 04:25:11,046: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1ce85c8-d820-4a84-ac2e-50a977b609b5] succeeded in 2.1995347890006087s: None 2024-02-23T04:25:38.836447579Z [2024-02-23 04:25:38,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfba32f2-7cbd-42d9-ba06-5818b8cf7c9d] received 2024-02-23T04:25:38.848762903Z [2024-02-23 04:25:38,848: INFO/ForkPoolWorker-15] [dfba32f2-7cbd-42d9-ba06-5818b8cf7c9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223042537_670085', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:25:39.134779225Z [2024-02-23 04:25:39,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:25:39.484567723Z [2024-02-23 04:25:39,484: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:25:40.085081731Z [2024-02-23 04:25:40,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfba32f2-7cbd-42d9-ba06-5818b8cf7c9d] succeeded in 1.2453098070000124s: None 2024-02-23T04:26:01.247536411Z [2024-02-23 04:26:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fa75b5b-6cec-44b8-b37e-13c3966fd894] received 2024-02-23T04:26:01.255226632Z [2024-02-23 04:26:01,254: INFO/ForkPoolWorker-15] [3fa75b5b-6cec-44b8-b37e-13c3966fd894] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:26:01.255303995Z [2024-02-23 04:26:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[799688e0-009e-40ba-8097-9e130809f358] received 2024-02-23T04:26:01.260387219Z [2024-02-23 04:26:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63bf3a5e-c7e6-4442-9e46-beac71a0ad71] received 2024-02-23T04:26:01.262783533Z [2024-02-23 04:26:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aedd057-e93d-4a53-ad08-ab001ba2716d] received 2024-02-23T04:26:01.272667481Z [2024-02-23 04:26:01,272: INFO/ForkPoolWorker-2] [7aedd057-e93d-4a53-ad08-ab001ba2716d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:26:01.274998000Z [2024-02-23 04:26:01,274: INFO/ForkPoolWorker-1] [63bf3a5e-c7e6-4442-9e46-beac71a0ad71] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:26:01.276763663Z [2024-02-23 04:26:01,276: INFO/ForkPoolWorker-16] [799688e0-009e-40ba-8097-9e130809f358] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:26:01.591927844Z [2024-02-23 04:26:01,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:26:01.640042032Z [2024-02-23 04:26:01,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:26:01.663869980Z [2024-02-23 04:26:01,660: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:26:01.695426979Z [2024-02-23 04:26:01,691: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:26:01.961677662Z [2024-02-23 04:26:01,961: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:26:01.963664697Z [2024-02-23 04:26:01,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:26:01.965882330Z [2024-02-23 04:26:01,965: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:26:02.029856742Z [2024-02-23 04:26:02,029: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:26:02.032543536Z [2024-02-23 04:26:02,032: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:26:02.033142197Z [2024-02-23 04:26:02,032: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:26:02.033407709Z [2024-02-23 04:26:02,033: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:26:02.034050956Z [2024-02-23 04:26:02,033: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:26:02.194216955Z [2024-02-23 04:26:02,193: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:26:02.697338661Z [2024-02-23 04:26:02,696: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[799688e0-009e-40ba-8097-9e130809f358] succeeded in 1.4393294690016774s: None 2024-02-23T04:26:03.018751687Z [2024-02-23 04:26:03,018: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[63bf3a5e-c7e6-4442-9e46-beac71a0ad71] succeeded in 1.756148309999844s: None 2024-02-23T04:26:03.193442282Z [2024-02-23 04:26:03,193: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:26:03.196726303Z [2024-02-23 04:26:03,196: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:26:03.214053608Z [2024-02-23 04:26:03,213: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:26:03.215642587Z [2024-02-23 04:26:03,215: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:26:03.215811521Z [2024-02-23 04:26:03,215: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:26:03.215996376Z [2024-02-23 04:26:03,215: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:26:03.216053565Z [2024-02-23 04:26:03,215: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:26:03.216558466Z [2024-02-23 04:26:03,216: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:26:03.216698790Z [2024-02-23 04:26:03,216: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:26:03.247016805Z [2024-02-23 04:26:03,246: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:26:03.250179036Z [2024-02-23 04:26:03,249: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:26:03.270242273Z [2024-02-23 04:26:03,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:26:03.271950763Z [2024-02-23 04:26:03,271: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:26:03.271989433Z [2024-02-23 04:26:03,271: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:26:03.272154575Z [2024-02-23 04:26:03,271: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:26:03.272222535Z [2024-02-23 04:26:03,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:26:03.272503133Z [2024-02-23 04:26:03,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:26:03.272698858Z [2024-02-23 04:26:03,272: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:26:03.305200078Z [2024-02-23 04:26:03,304: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:26:03.397850670Z [2024-02-23 04:26:03,397: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:26:06.530980457Z [2024-02-23 04:26:06,529: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3fa75b5b-6cec-44b8-b37e-13c3966fd894] succeeded in 5.280688154001837s: None 2024-02-23T04:26:07.559834563Z [2024-02-23 04:26:07,558: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7aedd057-e93d-4a53-ad08-ab001ba2716d] succeeded in 6.294333990001178s: None 2024-02-23T04:27:00.609093728Z [2024-02-23 04:27:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec768f41-ffe9-4147-a559-7707373bc802] received 2024-02-23T04:27:00.614206327Z [2024-02-23 04:27:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d80d5b5-42e6-45ac-9fb1-7e608281127e] received 2024-02-23T04:27:00.617782020Z [2024-02-23 04:27:00,617: INFO/ForkPoolWorker-15] [ec768f41-ffe9-4147-a559-7707373bc802] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:27:00.618951690Z [2024-02-23 04:27:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5135766-bca9-4c76-9f57-32042000abe9] received 2024-02-23T04:27:00.621755935Z [2024-02-23 04:27:00,621: INFO/ForkPoolWorker-16] [0d80d5b5-42e6-45ac-9fb1-7e608281127e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:27:00.635520014Z [2024-02-23 04:27:00,635: INFO/ForkPoolWorker-1] [b5135766-bca9-4c76-9f57-32042000abe9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:27:00.938814788Z [2024-02-23 04:27:00,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:27:00.940201960Z [2024-02-23 04:27:00,936: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:27:00.961283978Z [2024-02-23 04:27:00,957: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:27:01.160539118Z [2024-02-23 04:27:01,160: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:27:01.164566697Z [2024-02-23 04:27:01,164: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:27:01.193325709Z [2024-02-23 04:27:01,193: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:27:01.194777985Z [2024-02-23 04:27:01,194: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:27:01.195360082Z [2024-02-23 04:27:01,195: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:27:01.195508802Z [2024-02-23 04:27:01,195: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:27:01.196405960Z [2024-02-23 04:27:01,196: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:27:01.305012306Z [2024-02-23 04:27:01,304: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:27:01.912122912Z [2024-02-23 04:27:01,911: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5135766-bca9-4c76-9f57-32042000abe9] succeeded in 1.2903390249994118s: None 2024-02-23T04:27:02.048463230Z [2024-02-23 04:27:02,047: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:27:02.051689307Z [2024-02-23 04:27:02,051: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:27:02.064361569Z [2024-02-23 04:27:02,063: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:27:02.067639500Z [2024-02-23 04:27:02,067: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:27:02.078935755Z [2024-02-23 04:27:02,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:27:02.080470728Z [2024-02-23 04:27:02,080: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:27:02.080493858Z [2024-02-23 04:27:02,080: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:27:02.080609912Z [2024-02-23 04:27:02,080: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:27:02.080663817Z [2024-02-23 04:27:02,080: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:27:02.080954727Z [2024-02-23 04:27:02,080: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:27:02.080993433Z [2024-02-23 04:27:02,080: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:27:02.107481348Z [2024-02-23 04:27:02,107: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:27:02.109328397Z [2024-02-23 04:27:02,109: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:27:02.109354996Z [2024-02-23 04:27:02,109: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:27:02.109376100Z [2024-02-23 04:27:02,109: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:27:02.109421579Z [2024-02-23 04:27:02,109: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:27:02.109679342Z [2024-02-23 04:27:02,109: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:27:02.109703641Z [2024-02-23 04:27:02,109: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:27:02.187471300Z [2024-02-23 04:27:02,187: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:27:02.206056733Z [2024-02-23 04:27:02,205: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:27:04.389883359Z [2024-02-23 04:27:04,389: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec768f41-ffe9-4147-a559-7707373bc802] succeeded in 3.779331576999539s: None 2024-02-23T04:27:05.036522175Z [2024-02-23 04:27:05,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d80d5b5-42e6-45ac-9fb1-7e608281127e] succeeded in 4.420268407000549s: None 2024-02-23T04:28:01.306458374Z [2024-02-23 04:28:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27590553-1727-4662-8b92-f965d549758b] received 2024-02-23T04:28:01.309213278Z [2024-02-23 04:28:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50537782-670f-4fb3-beee-39aacf920560] received 2024-02-23T04:28:01.310640346Z [2024-02-23 04:28:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58d44ccb-54ac-4e0f-b945-35a669b60e57] received 2024-02-23T04:28:01.311760109Z [2024-02-23 04:28:01,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4f33c86-e490-442d-8b45-5c181a35a762] received 2024-02-23T04:28:01.324519918Z [2024-02-23 04:28:01,324: INFO/ForkPoolWorker-1] [58d44ccb-54ac-4e0f-b945-35a669b60e57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:28:01.328449279Z [2024-02-23 04:28:01,328: INFO/ForkPoolWorker-2] [e4f33c86-e490-442d-8b45-5c181a35a762] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:28:01.329007072Z [2024-02-23 04:28:01,328: INFO/ForkPoolWorker-16] [50537782-670f-4fb3-beee-39aacf920560] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:28:01.329330822Z [2024-02-23 04:28:01,328: INFO/ForkPoolWorker-15] [27590553-1727-4662-8b92-f965d549758b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:28:01.666174127Z [2024-02-23 04:28:01,662: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:28:01.672171749Z [2024-02-23 04:28:01,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:28:01.683121180Z [2024-02-23 04:28:01,679: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:28:01.870251017Z [2024-02-23 04:28:01,869: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:28:01.874835414Z [2024-02-23 04:28:01,873: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:28:01.905359021Z [2024-02-23 04:28:01,905: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:28:01.906937566Z [2024-02-23 04:28:01,906: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:28:01.907116932Z [2024-02-23 04:28:01,906: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:28:01.907161297Z [2024-02-23 04:28:01,907: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:28:01.907379284Z [2024-02-23 04:28:01,907: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:28:01.971637954Z [2024-02-23 04:28:01,967: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:28:02.036321064Z [2024-02-23 04:28:02,036: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:28:02.039530514Z [2024-02-23 04:28:02,039: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:28:02.672181961Z [2024-02-23 04:28:02,671: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58d44ccb-54ac-4e0f-b945-35a669b60e57] succeeded in 1.3591189510007098s: None 2024-02-23T04:28:02.760906911Z [2024-02-23 04:28:02,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[50537782-670f-4fb3-beee-39aacf920560] succeeded in 1.450290323002264s: None 2024-02-23T04:28:03.238246335Z [2024-02-23 04:28:03,237: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:28:03.241803530Z [2024-02-23 04:28:03,241: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:28:03.268994392Z [2024-02-23 04:28:03,268: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:28:03.271046618Z [2024-02-23 04:28:03,270: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:28:03.271227730Z [2024-02-23 04:28:03,270: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:28:03.271500824Z [2024-02-23 04:28:03,271: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:28:03.271655009Z [2024-02-23 04:28:03,271: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:28:03.272066484Z [2024-02-23 04:28:03,271: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:28:03.272311934Z [2024-02-23 04:28:03,272: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:28:03.280190187Z [2024-02-23 04:28:03,279: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:28:03.284693580Z [2024-02-23 04:28:03,284: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:28:03.312275310Z [2024-02-23 04:28:03,312: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:28:03.314179369Z [2024-02-23 04:28:03,313: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:28:03.314450972Z [2024-02-23 04:28:03,314: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:28:03.314699336Z [2024-02-23 04:28:03,314: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:28:03.314804019Z [2024-02-23 04:28:03,314: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:28:03.315158777Z [2024-02-23 04:28:03,315: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:28:03.315257324Z [2024-02-23 04:28:03,315: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:28:03.385766094Z [2024-02-23 04:28:03,385: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:28:03.405335527Z [2024-02-23 04:28:03,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:28:05.117719507Z [2024-02-23 04:28:05,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27590553-1727-4662-8b92-f965d549758b] succeeded in 3.80948979599998s: None 2024-02-23T04:28:05.406138041Z [2024-02-23 04:28:05,405: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4f33c86-e490-442d-8b45-5c181a35a762] succeeded in 4.092339904000255s: None 2024-02-23T04:29:01.237278916Z [2024-02-23 04:29:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a564603-e8f2-4287-b2fa-cdb1ea722632] received 2024-02-23T04:29:01.241349395Z [2024-02-23 04:29:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f75d2eee-6d50-4a07-bf80-e333d8cf3f20] received 2024-02-23T04:29:01.245388187Z [2024-02-23 04:29:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b92d78e-f27b-4cbd-adcd-769b6595862a] received 2024-02-23T04:29:01.249684862Z [2024-02-23 04:29:01,249: INFO/ForkPoolWorker-15] [4a564603-e8f2-4287-b2fa-cdb1ea722632] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:29:01.252171500Z [2024-02-23 04:29:01,251: INFO/ForkPoolWorker-16] [f75d2eee-6d50-4a07-bf80-e333d8cf3f20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:29:01.263873410Z [2024-02-23 04:29:01,263: INFO/ForkPoolWorker-1] [3b92d78e-f27b-4cbd-adcd-769b6595862a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:29:01.633696944Z [2024-02-23 04:29:01,630: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:29:01.634436321Z [2024-02-23 04:29:01,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:29:01.679397436Z [2024-02-23 04:29:01,675: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:29:01.875663219Z [2024-02-23 04:29:01,875: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:29:01.880068911Z [2024-02-23 04:29:01,879: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:29:01.902108371Z [2024-02-23 04:29:01,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:29:01.903256163Z [2024-02-23 04:29:01,903: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:29:01.903518744Z [2024-02-23 04:29:01,903: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:29:01.903646311Z [2024-02-23 04:29:01,903: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:29:01.903996925Z [2024-02-23 04:29:01,903: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:29:02.040425191Z [2024-02-23 04:29:02,040: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:29:02.597210420Z [2024-02-23 04:29:02,596: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b92d78e-f27b-4cbd-adcd-769b6595862a] succeeded in 1.3478153429969097s: None 2024-02-23T04:29:02.799158069Z [2024-02-23 04:29:02,798: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:29:02.802515622Z [2024-02-23 04:29:02,802: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:29:02.822242462Z [2024-02-23 04:29:02,821: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:29:02.822770611Z [2024-02-23 04:29:02,822: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:29:02.825768733Z [2024-02-23 04:29:02,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:29:02.828347790Z [2024-02-23 04:29:02,828: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:29:02.828368980Z [2024-02-23 04:29:02,828: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:29:02.828572874Z [2024-02-23 04:29:02,828: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:29:02.828706682Z [2024-02-23 04:29:02,828: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:29:02.829004366Z [2024-02-23 04:29:02,828: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:29:02.829018797Z [2024-02-23 04:29:02,828: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:29:02.853490361Z [2024-02-23 04:29:02,853: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:29:02.854794000Z [2024-02-23 04:29:02,854: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:29:02.854979106Z [2024-02-23 04:29:02,854: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:29:02.855197111Z [2024-02-23 04:29:02,855: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:29:02.855340851Z [2024-02-23 04:29:02,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:29:02.855764581Z [2024-02-23 04:29:02,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:29:02.855907852Z [2024-02-23 04:29:02,855: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:29:02.947149640Z [2024-02-23 04:29:02,946: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:29:02.958735130Z [2024-02-23 04:29:02,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:29:04.729160444Z [2024-02-23 04:29:04,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a564603-e8f2-4287-b2fa-cdb1ea722632] succeeded in 3.4897349370003212s: None 2024-02-23T04:29:05.414031528Z [2024-02-23 04:29:05,413: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f75d2eee-6d50-4a07-bf80-e333d8cf3f20] succeeded in 4.1706139300004s: None 2024-02-23T04:30:01.223864954Z [2024-02-23 04:30:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a18bd90-73bf-4dc8-97c8-153fe9029dad] received 2024-02-23T04:30:01.227935677Z [2024-02-23 04:30:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fd3c825-42e3-4e6a-b1ea-abbff330e398] received 2024-02-23T04:30:01.229810881Z [2024-02-23 04:30:01,229: INFO/ForkPoolWorker-15] [9a18bd90-73bf-4dc8-97c8-153fe9029dad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:30:01.235737906Z [2024-02-23 04:30:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95f54094-c8b7-45fb-bedf-b114a75d5184] received 2024-02-23T04:30:01.235945693Z [2024-02-23 04:30:01,235: INFO/ForkPoolWorker-16] [3fd3c825-42e3-4e6a-b1ea-abbff330e398] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:30:01.246524776Z [2024-02-23 04:30:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b929a30-03de-4d66-9649-56856f6277d6] received 2024-02-23T04:30:01.252151137Z [2024-02-23 04:30:01,251: INFO/ForkPoolWorker-1] [95f54094-c8b7-45fb-bedf-b114a75d5184] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:30:01.259660627Z [2024-02-23 04:30:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bfe1a2c-16d4-40bb-9e09-30b5daa84f97] received 2024-02-23T04:30:01.274234369Z [2024-02-23 04:30:01,273: INFO/ForkPoolWorker-2] [3b929a30-03de-4d66-9649-56856f6277d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:30:01.288635700Z [2024-02-23 04:30:01,286: INFO/ForkPoolWorker-3] [1bfe1a2c-16d4-40bb-9e09-30b5daa84f97] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:30:01.624398518Z [2024-02-23 04:30:01,619: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:30:01.704414920Z [2024-02-23 04:30:01,700: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:30:01.933005115Z [2024-02-23 04:30:01,929: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:30:01.989693128Z [2024-02-23 04:30:01,985: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:30:02.010004102Z [2024-02-23 04:30:02,006: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:30:02.043461005Z [2024-02-23 04:30:02,043: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:02.388820592Z [2024-02-23 04:30:02,388: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:30:02.400801126Z [2024-02-23 04:30:02,400: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:02.454353676Z [2024-02-23 04:30:02,454: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:30:02.455968909Z [2024-02-23 04:30:02,455: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:30:02.456181014Z [2024-02-23 04:30:02,455: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:30:02.456350229Z [2024-02-23 04:30:02,456: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:30:02.456614864Z [2024-02-23 04:30:02,456: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:30:02.620219698Z [2024-02-23 04:30:02,619: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:02.734995595Z [2024-02-23 04:30:02,734: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1bfe1a2c-16d4-40bb-9e09-30b5daa84f97] succeeded in 1.4693798560001596s: None 2024-02-23T04:30:03.135521098Z [2024-02-23 04:30:03,135: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fd3c825-42e3-4e6a-b1ea-abbff330e398] succeeded in 1.9061628349991224s: None 2024-02-23T04:30:03.192224148Z [2024-02-23 04:30:03,191: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:30:03.195703358Z [2024-02-23 04:30:03,195: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:03.222368282Z [2024-02-23 04:30:03,222: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:30:03.225375216Z [2024-02-23 04:30:03,225: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:30:03.225582497Z [2024-02-23 04:30:03,225: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:30:03.225755886Z [2024-02-23 04:30:03,225: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:30:03.225804368Z [2024-02-23 04:30:03,225: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:30:03.226157387Z [2024-02-23 04:30:03,225: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:30:03.226236547Z [2024-02-23 04:30:03,226: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:30:03.305946470Z [2024-02-23 04:30:03,305: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:03.491892878Z [2024-02-23 04:30:03,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:30:03.494549460Z [2024-02-23 04:30:03,494: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:30:03.495125850Z [2024-02-23 04:30:03,494: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:03.498049036Z [2024-02-23 04:30:03,497: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:03.515647870Z [2024-02-23 04:30:03,515: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:30:03.517007461Z [2024-02-23 04:30:03,516: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:30:03.517049068Z [2024-02-23 04:30:03,516: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:30:03.517154317Z [2024-02-23 04:30:03,516: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:30:03.517222799Z [2024-02-23 04:30:03,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:30:03.517436119Z [2024-02-23 04:30:03,517: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:30:03.517473780Z [2024-02-23 04:30:03,517: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:30:03.520516148Z [2024-02-23 04:30:03,520: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:30:03.522422207Z [2024-02-23 04:30:03,522: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:30:03.522696781Z [2024-02-23 04:30:03,522: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:30:03.523131643Z [2024-02-23 04:30:03,522: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:30:03.523445241Z [2024-02-23 04:30:03,523: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:30:03.524028924Z [2024-02-23 04:30:03,523: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:30:03.524274128Z [2024-02-23 04:30:03,523: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:30:03.608278100Z [2024-02-23 04:30:03,604: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:03.651430100Z [2024-02-23 04:30:03,651: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:04.379089122Z [2024-02-23 04:30:04,377: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95f54094-c8b7-45fb-bedf-b114a75d5184] succeeded in 3.14018017899798s: None 2024-02-23T04:30:05.049293739Z [2024-02-23 04:30:05,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3935341-192d-415b-9435-031f84442416] received 2024-02-23T04:30:05.057355203Z [2024-02-23 04:30:05,056: INFO/ForkPoolWorker-16] [e3935341-192d-415b-9435-031f84442416] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:30:05.331819790Z [2024-02-23 04:30:05,331: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3b929a30-03de-4d66-9649-56856f6277d6] succeeded in 4.0732864160017925s: None 2024-02-23T04:30:05.476456388Z [2024-02-23 04:30:05,473: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:30:06.259951488Z [2024-02-23 04:30:06,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a18bd90-73bf-4dc8-97c8-153fe9029dad] succeeded in 5.034705286001554s: None 2024-02-23T04:30:06.614516974Z [2024-02-23 04:30:06,614: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:30:06.617903533Z [2024-02-23 04:30:06,617: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:06.634708949Z [2024-02-23 04:30:06,634: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:30:06.635982851Z [2024-02-23 04:30:06,635: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:30:06.636073958Z [2024-02-23 04:30:06,635: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:30:06.636222498Z [2024-02-23 04:30:06,636: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:30:06.636297273Z [2024-02-23 04:30:06,636: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:30:06.636572696Z [2024-02-23 04:30:06,636: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:30:06.636647619Z [2024-02-23 04:30:06,636: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:30:06.731209334Z [2024-02-23 04:30:06,730: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:07.403650298Z [2024-02-23 04:30:07,402: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3935341-192d-415b-9435-031f84442416] succeeded in 2.351303421000921s: None 2024-02-23T04:30:07.563058214Z [2024-02-23 04:30:07,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e89b3406-7b6e-4866-b43c-236c36628bfd] received 2024-02-23T04:30:07.574443575Z [2024-02-23 04:30:07,574: INFO/ForkPoolWorker-15] [e89b3406-7b6e-4866-b43c-236c36628bfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:30:07.879741433Z [2024-02-23 04:30:07,876: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:30:09.002035653Z [2024-02-23 04:30:09,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:30:09.005257026Z [2024-02-23 04:30:09,004: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:09.022805182Z [2024-02-23 04:30:09,022: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:30:09.024047348Z [2024-02-23 04:30:09,023: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:30:09.024145266Z [2024-02-23 04:30:09,024: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:30:09.024303673Z [2024-02-23 04:30:09,024: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:30:09.024389873Z [2024-02-23 04:30:09,024: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:30:09.024653719Z [2024-02-23 04:30:09,024: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:30:09.024740605Z [2024-02-23 04:30:09,024: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:30:09.118561710Z [2024-02-23 04:30:09,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:09.648150279Z [2024-02-23 04:30:09,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e89b3406-7b6e-4866-b43c-236c36628bfd] succeeded in 2.0832828040001914s: None 2024-02-23T04:30:10.272635589Z [2024-02-23 04:30:10,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99a98dba-eacc-45f1-be88-f28c6690dcf7] received 2024-02-23T04:30:10.278192125Z [2024-02-23 04:30:10,277: INFO/ForkPoolWorker-15] [99a98dba-eacc-45f1-be88-f28c6690dcf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:30:10.595509341Z [2024-02-23 04:30:10,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:30:11.735673899Z [2024-02-23 04:30:11,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:30:11.739009022Z [2024-02-23 04:30:11,738: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:30:11.757955351Z [2024-02-23 04:30:11,757: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:30:11.759242049Z [2024-02-23 04:30:11,759: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:30:11.759291871Z [2024-02-23 04:30:11,759: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:30:11.759477830Z [2024-02-23 04:30:11,759: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:30:11.759527534Z [2024-02-23 04:30:11,759: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:30:11.759809846Z [2024-02-23 04:30:11,759: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:30:11.759898008Z [2024-02-23 04:30:11,759: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:30:11.838394288Z [2024-02-23 04:30:11,838: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:30:12.295041260Z [2024-02-23 04:30:12,294: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99a98dba-eacc-45f1-be88-f28c6690dcf7] succeeded in 2.02078855900254s: None 2024-02-23T04:31:01.115130691Z [2024-02-23 04:31:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c535b139-9250-4262-a173-a226bf5e2e34] received 2024-02-23T04:31:01.125895227Z [2024-02-23 04:31:01,125: INFO/ForkPoolWorker-15] [c535b139-9250-4262-a173-a226bf5e2e34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:31:01.136921943Z [2024-02-23 04:31:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c01c30b2-40de-4116-80a7-e30ba34e824b] received 2024-02-23T04:31:01.138710674Z [2024-02-23 04:31:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[114d2431-d77b-4611-bb77-f361a7c79b5b] received 2024-02-23T04:31:01.148492439Z [2024-02-23 04:31:01,148: INFO/ForkPoolWorker-16] [c01c30b2-40de-4116-80a7-e30ba34e824b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:31:01.154490624Z [2024-02-23 04:31:01,154: INFO/ForkPoolWorker-1] [114d2431-d77b-4611-bb77-f361a7c79b5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:31:01.462328170Z [2024-02-23 04:31:01,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:31:01.496987694Z [2024-02-23 04:31:01,490: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:31:01.543234397Z [2024-02-23 04:31:01,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:31:01.723449003Z [2024-02-23 04:31:01,717: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:31:01.723527633Z [2024-02-23 04:31:01,722: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:31:01.751743651Z [2024-02-23 04:31:01,751: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:31:01.753554695Z [2024-02-23 04:31:01,753: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:31:01.753613113Z [2024-02-23 04:31:01,753: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:31:01.753696546Z [2024-02-23 04:31:01,753: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:31:01.753947575Z [2024-02-23 04:31:01,753: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:31:01.858268354Z [2024-02-23 04:31:01,857: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:31:02.545414247Z [2024-02-23 04:31:02,544: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[114d2431-d77b-4611-bb77-f361a7c79b5b] succeeded in 1.4038150550004502s: None 2024-02-23T04:31:02.843375171Z [2024-02-23 04:31:02,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:31:02.846659411Z [2024-02-23 04:31:02,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:31:02.852908046Z [2024-02-23 04:31:02,852: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:31:02.856696972Z [2024-02-23 04:31:02,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:31:02.864528004Z [2024-02-23 04:31:02,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:31:02.866070958Z [2024-02-23 04:31:02,865: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:31:02.866173301Z [2024-02-23 04:31:02,866: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:31:02.866319197Z [2024-02-23 04:31:02,866: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:31:02.866394031Z [2024-02-23 04:31:02,866: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:31:02.866652318Z [2024-02-23 04:31:02,866: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:31:02.866774175Z [2024-02-23 04:31:02,866: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:31:02.886295212Z [2024-02-23 04:31:02,886: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:31:02.887843250Z [2024-02-23 04:31:02,887: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:31:02.888058617Z [2024-02-23 04:31:02,887: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:31:02.888402753Z [2024-02-23 04:31:02,888: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:31:02.888592922Z [2024-02-23 04:31:02,888: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:31:02.889132402Z [2024-02-23 04:31:02,888: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:31:02.889341907Z [2024-02-23 04:31:02,889: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:31:02.953965419Z [2024-02-23 04:31:02,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:31:03.001182099Z [2024-02-23 04:31:03,000: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:31:05.075661356Z [2024-02-23 04:31:05,075: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c01c30b2-40de-4116-80a7-e30ba34e824b] succeeded in 3.936750025000947s: None 2024-02-23T04:31:05.397331630Z [2024-02-23 04:31:05,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c535b139-9250-4262-a173-a226bf5e2e34] succeeded in 4.278405291999661s: None 2024-02-23T04:32:00.681817443Z [2024-02-23 04:32:00,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[689a9454-6644-4095-9999-eab30b2f5512] received 2024-02-23T04:32:00.685128414Z [2024-02-23 04:32:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f781be91-38e0-4d07-a684-aba3e0bd3138] received 2024-02-23T04:32:00.688222513Z [2024-02-23 04:32:00,688: INFO/ForkPoolWorker-15] [689a9454-6644-4095-9999-eab30b2f5512] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:32:00.693850258Z [2024-02-23 04:32:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba46f3b6-b16f-49ba-a414-99524982f1aa] received 2024-02-23T04:32:00.698935688Z [2024-02-23 04:32:00,698: INFO/ForkPoolWorker-16] [f781be91-38e0-4d07-a684-aba3e0bd3138] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:32:00.704593891Z [2024-02-23 04:32:00,704: INFO/ForkPoolWorker-1] [ba46f3b6-b16f-49ba-a414-99524982f1aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:32:00.710852700Z [2024-02-23 04:32:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef7c1731-a305-4aad-ad64-d569006340b9] received 2024-02-23T04:32:00.722817534Z [2024-02-23 04:32:00,722: INFO/ForkPoolWorker-2] [ef7c1731-a305-4aad-ad64-d569006340b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:32:01.054760564Z [2024-02-23 04:32:01,051: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:32:01.134731956Z [2024-02-23 04:32:01,131: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:32:01.161529824Z [2024-02-23 04:32:01,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:32:01.196846813Z [2024-02-23 04:32:01,192: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:32:01.300882864Z [2024-02-23 04:32:01,300: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:32:01.305017433Z [2024-02-23 04:32:01,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:32:01.307000148Z [2024-02-23 04:32:01,306: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:32:01.326195964Z [2024-02-23 04:32:01,325: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:32:01.331117288Z [2024-02-23 04:32:01,327: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:32:01.332332835Z [2024-02-23 04:32:01,332: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:32:01.332378247Z [2024-02-23 04:32:01,332: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:32:01.332864268Z [2024-02-23 04:32:01,332: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:32:01.427310805Z [2024-02-23 04:32:01,427: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:32:01.953598673Z [2024-02-23 04:32:01,953: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f781be91-38e0-4d07-a684-aba3e0bd3138] succeeded in 1.2661423370009288s: None 2024-02-23T04:32:02.100672170Z [2024-02-23 04:32:02,100: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba46f3b6-b16f-49ba-a414-99524982f1aa] succeeded in 1.4051417949995084s: None 2024-02-23T04:32:02.614568133Z [2024-02-23 04:32:02,614: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:32:02.618250269Z [2024-02-23 04:32:02,617: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:32:02.648605972Z [2024-02-23 04:32:02,648: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:32:02.650135471Z [2024-02-23 04:32:02,649: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:32:02.650240506Z [2024-02-23 04:32:02,650: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:32:02.650445344Z [2024-02-23 04:32:02,650: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:32:02.650543873Z [2024-02-23 04:32:02,650: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:32:02.650989283Z [2024-02-23 04:32:02,650: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:32:02.651056439Z [2024-02-23 04:32:02,650: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:32:02.689328026Z [2024-02-23 04:32:02,688: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:32:02.692796746Z [2024-02-23 04:32:02,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:32:02.719479273Z [2024-02-23 04:32:02,719: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:32:02.722085898Z [2024-02-23 04:32:02,721: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:32:02.722128852Z [2024-02-23 04:32:02,721: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:32:02.722332675Z [2024-02-23 04:32:02,722: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:32:02.722353271Z [2024-02-23 04:32:02,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:32:02.722666011Z [2024-02-23 04:32:02,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:32:02.722731082Z [2024-02-23 04:32:02,722: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:32:02.775067630Z [2024-02-23 04:32:02,774: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:32:02.872419907Z [2024-02-23 04:32:02,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:32:04.660366552Z [2024-02-23 04:32:04,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[689a9454-6644-4095-9999-eab30b2f5512] succeeded in 3.976613245002227s: None 2024-02-23T04:32:04.686029382Z [2024-02-23 04:32:04,685: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ef7c1731-a305-4aad-ad64-d569006340b9] succeeded in 3.97342620499694s: None 2024-02-23T04:32:28.572649135Z [2024-02-23 04:32:28,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[460e257f-e626-42f6-93d4-233bcd66b31b] received 2024-02-23T04:32:28.580464043Z [2024-02-23 04:32:28,580: INFO/ForkPoolWorker-15] [460e257f-e626-42f6-93d4-233bcd66b31b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223043227_719391', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:32:28.866345365Z [2024-02-23 04:32:28,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:32:29.162931245Z [2024-02-23 04:32:29,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:32:29.873233997Z [2024-02-23 04:32:29,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[460e257f-e626-42f6-93d4-233bcd66b31b] succeeded in 1.29874314600238s: None 2024-02-23T04:33:00.934691337Z [2024-02-23 04:33:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51b85ea8-0bd0-4b8d-ac74-1962422b64f7] received 2024-02-23T04:33:00.940645059Z [2024-02-23 04:33:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d49cffc-84fe-44e3-9b4d-ec463e1b6223] received 2024-02-23T04:33:00.941507100Z [2024-02-23 04:33:00,941: INFO/ForkPoolWorker-15] [51b85ea8-0bd0-4b8d-ac74-1962422b64f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:33:00.949058756Z [2024-02-23 04:33:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93421315-30cd-4d7b-b7ee-e6e8cff10882] received 2024-02-23T04:33:00.958615334Z [2024-02-23 04:33:00,958: INFO/ForkPoolWorker-16] [8d49cffc-84fe-44e3-9b4d-ec463e1b6223] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:33:00.965454969Z [2024-02-23 04:33:00,965: INFO/ForkPoolWorker-1] [93421315-30cd-4d7b-b7ee-e6e8cff10882] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:33:01.267449988Z [2024-02-23 04:33:01,258: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:33:01.305732911Z [2024-02-23 04:33:01,302: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:33:01.306494494Z [2024-02-23 04:33:01,303: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:33:01.470014976Z [2024-02-23 04:33:01,469: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:33:01.474126187Z [2024-02-23 04:33:01,473: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:33:01.502215115Z [2024-02-23 04:33:01,501: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:33:01.504181816Z [2024-02-23 04:33:01,503: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:33:01.504763597Z [2024-02-23 04:33:01,504: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:33:01.505296014Z [2024-02-23 04:33:01,505: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:33:01.505732347Z [2024-02-23 04:33:01,505: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:33:01.598093158Z [2024-02-23 04:33:01,597: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:33:02.227055461Z [2024-02-23 04:33:02,226: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[93421315-30cd-4d7b-b7ee-e6e8cff10882] succeeded in 1.2751173329997982s: None 2024-02-23T04:33:02.426846901Z [2024-02-23 04:33:02,426: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:33:02.431987916Z [2024-02-23 04:33:02,431: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:33:02.458446565Z [2024-02-23 04:33:02,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:33:02.459981584Z [2024-02-23 04:33:02,459: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:33:02.460148085Z [2024-02-23 04:33:02,459: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:33:02.460383168Z [2024-02-23 04:33:02,460: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:33:02.460537629Z [2024-02-23 04:33:02,460: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:33:02.461200367Z [2024-02-23 04:33:02,460: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:33:02.461213623Z [2024-02-23 04:33:02,461: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:33:02.510218236Z [2024-02-23 04:33:02,509: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:33:02.513598361Z [2024-02-23 04:33:02,513: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:33:02.539760555Z [2024-02-23 04:33:02,539: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:33:02.541590151Z [2024-02-23 04:33:02,541: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:33:02.541652874Z [2024-02-23 04:33:02,541: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:33:02.541928033Z [2024-02-23 04:33:02,541: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:33:02.541999269Z [2024-02-23 04:33:02,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:33:02.542922475Z [2024-02-23 04:33:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:33:02.543165756Z [2024-02-23 04:33:02,542: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:33:02.589141863Z [2024-02-23 04:33:02,588: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:33:02.635713924Z [2024-02-23 04:33:02,635: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:33:05.355216199Z [2024-02-23 04:33:05,354: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d49cffc-84fe-44e3-9b4d-ec463e1b6223] succeeded in 4.4104914470008225s: None 2024-02-23T04:33:05.519978261Z [2024-02-23 04:33:05,519: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51b85ea8-0bd0-4b8d-ac74-1962422b64f7] succeeded in 4.583754018000036s: None 2024-02-23T04:34:01.206691742Z [2024-02-23 04:34:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7629cc1-3fc0-457d-bd41-9768abb57e3b] received 2024-02-23T04:34:01.211602183Z [2024-02-23 04:34:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77e978bd-4834-4cbf-a182-6de31fdf08a1] received 2024-02-23T04:34:01.218624515Z [2024-02-23 04:34:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c79bdbd-4515-417b-8c25-90b5e2633d94] received 2024-02-23T04:34:01.219717327Z [2024-02-23 04:34:01,219: INFO/ForkPoolWorker-16] [77e978bd-4834-4cbf-a182-6de31fdf08a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:34:01.222309387Z [2024-02-23 04:34:01,221: INFO/ForkPoolWorker-15] [a7629cc1-3fc0-457d-bd41-9768abb57e3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:34:01.227062102Z [2024-02-23 04:34:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb57638e-f546-4982-bda9-8c77f30b0e01] received 2024-02-23T04:34:01.232098722Z [2024-02-23 04:34:01,231: INFO/ForkPoolWorker-1] [1c79bdbd-4515-417b-8c25-90b5e2633d94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:34:01.241975751Z [2024-02-23 04:34:01,241: INFO/ForkPoolWorker-2] [eb57638e-f546-4982-bda9-8c77f30b0e01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:34:01.525051107Z [2024-02-23 04:34:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:34:01.547732840Z [2024-02-23 04:34:01,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:34:01.689490497Z [2024-02-23 04:34:01,686: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:34:01.779234070Z [2024-02-23 04:34:01,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:34:01.807796553Z [2024-02-23 04:34:01,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:34:01.921101898Z [2024-02-23 04:34:01,920: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:34:01.925240523Z [2024-02-23 04:34:01,924: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:34:01.979927151Z [2024-02-23 04:34:01,979: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:34:01.981090492Z [2024-02-23 04:34:01,980: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:34:01.981288424Z [2024-02-23 04:34:01,981: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:34:01.981407083Z [2024-02-23 04:34:01,981: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:34:01.981722518Z [2024-02-23 04:34:01,981: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:34:02.095089370Z [2024-02-23 04:34:02,094: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:34:02.469725326Z [2024-02-23 04:34:02,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7629cc1-3fc0-457d-bd41-9768abb57e3b] succeeded in 1.2612012530007632s: None 2024-02-23T04:34:02.732113739Z [2024-02-23 04:34:02,731: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb57638e-f546-4982-bda9-8c77f30b0e01] succeeded in 1.5025020049979503s: None 2024-02-23T04:34:02.805686909Z [2024-02-23 04:34:02,805: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:34:02.808973444Z [2024-02-23 04:34:02,808: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:34:02.845743153Z [2024-02-23 04:34:02,845: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:34:02.848224411Z [2024-02-23 04:34:02,847: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:34:02.848330320Z [2024-02-23 04:34:02,848: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:34:02.848470173Z [2024-02-23 04:34:02,848: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:34:02.848532047Z [2024-02-23 04:34:02,848: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:34:02.848996162Z [2024-02-23 04:34:02,848: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:34:02.849069702Z [2024-02-23 04:34:02,848: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:34:02.942447445Z [2024-02-23 04:34:02,942: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:34:03.085273315Z [2024-02-23 04:34:03,084: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:34:03.089437347Z [2024-02-23 04:34:03,089: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:34:03.113399307Z [2024-02-23 04:34:03,113: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:34:03.115042338Z [2024-02-23 04:34:03,114: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:34:03.115158548Z [2024-02-23 04:34:03,115: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:34:03.115339639Z [2024-02-23 04:34:03,115: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:34:03.115436197Z [2024-02-23 04:34:03,115: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:34:03.115723483Z [2024-02-23 04:34:03,115: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:34:03.115876212Z [2024-02-23 04:34:03,115: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:34:03.190974814Z [2024-02-23 04:34:03,190: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:34:05.784193997Z [2024-02-23 04:34:05,783: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77e978bd-4834-4cbf-a182-6de31fdf08a1] succeeded in 4.570424007000838s: None 2024-02-23T04:34:05.996275274Z [2024-02-23 04:34:05,995: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c79bdbd-4515-417b-8c25-90b5e2633d94] succeeded in 4.774633686996822s: None 2024-02-23T04:34:28.380687660Z [2024-02-23 04:34:28,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a07c114-9e31-4a97-b6fa-3ab7a06c41d9] received 2024-02-23T04:34:28.393873991Z [2024-02-23 04:34:28,393: INFO/ForkPoolWorker-15] [4a07c114-9e31-4a97-b6fa-3ab7a06c41d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223043427_692369', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:34:28.701277345Z [2024-02-23 04:34:28,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:34:29.000675249Z [2024-02-23 04:34:29,000: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:34:29.666642419Z [2024-02-23 04:34:29,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a07c114-9e31-4a97-b6fa-3ab7a06c41d9] succeeded in 1.282422989999759s: None 2024-02-23T04:35:01.297820959Z [2024-02-23 04:35:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c5aeca4-2b6e-46b7-8ce7-f879870f0a43] received 2024-02-23T04:35:01.299714135Z [2024-02-23 04:35:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78df660b-7d2b-4b02-a20a-0fb781b1987c] received 2024-02-23T04:35:01.303252787Z [2024-02-23 04:35:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb4b47ec-db6a-4fc0-af37-b6d39076b318] received 2024-02-23T04:35:01.303780459Z [2024-02-23 04:35:01,303: INFO/ForkPoolWorker-15] [4c5aeca4-2b6e-46b7-8ce7-f879870f0a43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:35:01.306740350Z [2024-02-23 04:35:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f7741f5-4314-4b38-9ddb-0fdbb6740122] received 2024-02-23T04:35:01.314088402Z [2024-02-23 04:35:01,313: INFO/ForkPoolWorker-1] [fb4b47ec-db6a-4fc0-af37-b6d39076b318] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:35:01.315178073Z [2024-02-23 04:35:01,314: INFO/ForkPoolWorker-2] [7f7741f5-4314-4b38-9ddb-0fdbb6740122] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:35:01.320179004Z [2024-02-23 04:35:01,319: INFO/ForkPoolWorker-16] [78df660b-7d2b-4b02-a20a-0fb781b1987c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:35:01.648023221Z [2024-02-23 04:35:01,644: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:35:01.698501268Z [2024-02-23 04:35:01,695: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:35:01.703851876Z [2024-02-23 04:35:01,698: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:35:01.734458985Z [2024-02-23 04:35:01,730: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:35:01.932633320Z [2024-02-23 04:35:01,932: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:35:01.945670621Z [2024-02-23 04:35:01,945: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:01.970816548Z [2024-02-23 04:35:01,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:35:01.972000827Z [2024-02-23 04:35:01,971: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:35:01.972055088Z [2024-02-23 04:35:01,971: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:35:01.972104268Z [2024-02-23 04:35:01,972: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:35:01.972280678Z [2024-02-23 04:35:01,972: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:35:02.058723540Z [2024-02-23 04:35:02,058: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:02.566035604Z [2024-02-23 04:35:02,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78df660b-7d2b-4b02-a20a-0fb781b1987c] succeeded in 1.262990503997571s: None 2024-02-23T04:35:02.923369405Z [2024-02-23 04:35:02,922: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:35:02.926973765Z [2024-02-23 04:35:02,926: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:02.972833463Z [2024-02-23 04:35:02,972: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:35:02.974759306Z [2024-02-23 04:35:02,974: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:35:02.975050365Z [2024-02-23 04:35:02,974: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:35:02.975366501Z [2024-02-23 04:35:02,975: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:35:02.975610286Z [2024-02-23 04:35:02,975: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:35:02.976661030Z [2024-02-23 04:35:02,976: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:35:02.976847437Z [2024-02-23 04:35:02,976: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:35:03.009558524Z [2024-02-23 04:35:03,009: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:35:03.012762572Z [2024-02-23 04:35:03,012: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:03.035539700Z [2024-02-23 04:35:03,035: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:35:03.036973022Z [2024-02-23 04:35:03,036: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:35:03.037006303Z [2024-02-23 04:35:03,036: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:35:03.037043316Z [2024-02-23 04:35:03,036: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:35:03.037051149Z [2024-02-23 04:35:03,037: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:35:03.037370316Z [2024-02-23 04:35:03,037: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:35:03.037376541Z [2024-02-23 04:35:03,037: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:35:03.065290742Z [2024-02-23 04:35:03,064: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:03.124307762Z [2024-02-23 04:35:03,122: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:35:03.130031924Z [2024-02-23 04:35:03,129: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:03.132526609Z [2024-02-23 04:35:03,132: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:03.161790310Z [2024-02-23 04:35:03,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:35:03.163648320Z [2024-02-23 04:35:03,163: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:35:03.163890228Z [2024-02-23 04:35:03,163: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:35:03.164142223Z [2024-02-23 04:35:03,163: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:35:03.164363461Z [2024-02-23 04:35:03,164: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:35:03.164743742Z [2024-02-23 04:35:03,164: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:35:03.165239832Z [2024-02-23 04:35:03,165: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:35:03.261326030Z [2024-02-23 04:35:03,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:03.685368815Z [2024-02-23 04:35:03,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fb4b47ec-db6a-4fc0-af37-b6d39076b318] succeeded in 2.380373062998842s: None 2024-02-23T04:35:04.084179190Z [2024-02-23 04:35:04,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f835b1ef-5655-4a47-a88a-4f5c8fe5537c] received 2024-02-23T04:35:04.106957352Z [2024-02-23 04:35:04,106: INFO/ForkPoolWorker-16] [f835b1ef-5655-4a47-a88a-4f5c8fe5537c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:35:04.376218202Z [2024-02-23 04:35:04,373: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:35:05.122555332Z [2024-02-23 04:35:05,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c5aeca4-2b6e-46b7-8ce7-f879870f0a43] succeeded in 3.82285397799933s: None 2024-02-23T04:35:05.618472725Z [2024-02-23 04:35:05,618: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:35:05.624500608Z [2024-02-23 04:35:05,623: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:05.657515135Z [2024-02-23 04:35:05,657: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:35:05.659000500Z [2024-02-23 04:35:05,658: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:35:05.659519029Z [2024-02-23 04:35:05,659: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:35:05.659806774Z [2024-02-23 04:35:05,659: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:35:05.659957666Z [2024-02-23 04:35:05,659: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:35:05.660649082Z [2024-02-23 04:35:05,660: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:35:05.660787840Z [2024-02-23 04:35:05,660: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:35:05.665088888Z [2024-02-23 04:35:05,664: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f7741f5-4314-4b38-9ddb-0fdbb6740122] succeeded in 4.356381273999432s: None 2024-02-23T04:35:05.752968478Z [2024-02-23 04:35:05,752: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:06.389813837Z [2024-02-23 04:35:06,388: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f835b1ef-5655-4a47-a88a-4f5c8fe5537c] succeeded in 2.3024843510029314s: None 2024-02-23T04:35:06.611711119Z [2024-02-23 04:35:06,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fe89975-c4dc-47b4-ad0d-a314f1590518] received 2024-02-23T04:35:06.619308050Z [2024-02-23 04:35:06,619: INFO/ForkPoolWorker-15] [3fe89975-c4dc-47b4-ad0d-a314f1590518] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:35:06.879212141Z [2024-02-23 04:35:06,876: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:35:07.988793041Z [2024-02-23 04:35:07,988: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:35:07.992043233Z [2024-02-23 04:35:07,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:08.025476502Z [2024-02-23 04:35:08,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:35:08.027030177Z [2024-02-23 04:35:08,026: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:35:08.027158669Z [2024-02-23 04:35:08,027: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:35:08.027370445Z [2024-02-23 04:35:08,027: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:35:08.027463304Z [2024-02-23 04:35:08,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:35:08.027924902Z [2024-02-23 04:35:08,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:35:08.027954589Z [2024-02-23 04:35:08,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:35:08.127025290Z [2024-02-23 04:35:08,126: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:08.726463332Z [2024-02-23 04:35:08,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3fe89975-c4dc-47b4-ad0d-a314f1590518] succeeded in 2.11141296599817s: None 2024-02-23T04:35:09.272498080Z [2024-02-23 04:35:09,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27357177-c2ff-4c09-9218-5ae7cec728d3] received 2024-02-23T04:35:09.280259314Z [2024-02-23 04:35:09,279: INFO/ForkPoolWorker-15] [27357177-c2ff-4c09-9218-5ae7cec728d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:35:09.543364282Z [2024-02-23 04:35:09,540: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:35:10.634325310Z [2024-02-23 04:35:10,633: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:35:10.637364186Z [2024-02-23 04:35:10,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:35:10.660175690Z [2024-02-23 04:35:10,659: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:35:10.661542352Z [2024-02-23 04:35:10,661: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:35:10.661563782Z [2024-02-23 04:35:10,661: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:35:10.661692267Z [2024-02-23 04:35:10,661: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:35:10.661743753Z [2024-02-23 04:35:10,661: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:35:10.662059944Z [2024-02-23 04:35:10,661: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:35:10.662214252Z [2024-02-23 04:35:10,661: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:35:10.782746757Z [2024-02-23 04:35:10,782: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:35:11.448137291Z [2024-02-23 04:35:11,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27357177-c2ff-4c09-9218-5ae7cec728d3] succeeded in 2.173492059999262s: None 2024-02-23T04:36:00.291479309Z [2024-02-23 04:36:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc1f148f-0202-4f07-bebc-9dfaea9afdcd] received 2024-02-23T04:36:00.298633461Z [2024-02-23 04:36:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2ffc2d8-5741-4024-b0b3-08bafcb39ad3] received 2024-02-23T04:36:00.305359502Z [2024-02-23 04:36:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f76cf27e-c724-4186-aaca-a4cf25a3859f] received 2024-02-23T04:36:00.308301519Z [2024-02-23 04:36:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbe1fb2c-de63-4360-a306-cbf71db2deb3] received 2024-02-23T04:36:00.315404596Z [2024-02-23 04:36:00,315: INFO/ForkPoolWorker-16] [b2ffc2d8-5741-4024-b0b3-08bafcb39ad3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:36:00.315938728Z [2024-02-23 04:36:00,315: INFO/ForkPoolWorker-1] [f76cf27e-c724-4186-aaca-a4cf25a3859f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:36:00.323780090Z [2024-02-23 04:36:00,323: INFO/ForkPoolWorker-15] [cc1f148f-0202-4f07-bebc-9dfaea9afdcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:36:00.326004754Z [2024-02-23 04:36:00,325: INFO/ForkPoolWorker-2] [dbe1fb2c-de63-4360-a306-cbf71db2deb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:36:00.615267328Z [2024-02-23 04:36:00,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:36:00.681722848Z [2024-02-23 04:36:00,678: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:36:00.759225544Z [2024-02-23 04:36:00,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:36:00.841898680Z [2024-02-23 04:36:00,838: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:36:00.861546375Z [2024-02-23 04:36:00,861: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:36:01.077695263Z [2024-02-23 04:36:01,077: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:36:01.081792515Z [2024-02-23 04:36:01,081: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:36:01.131756027Z [2024-02-23 04:36:01,131: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:36:01.135813864Z [2024-02-23 04:36:01,135: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:36:01.136204046Z [2024-02-23 04:36:01,135: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:36:01.136453334Z [2024-02-23 04:36:01,136: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:36:01.136890712Z [2024-02-23 04:36:01,136: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:36:01.238531316Z [2024-02-23 04:36:01,238: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:36:01.464492329Z [2024-02-23 04:36:01,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc1f148f-0202-4f07-bebc-9dfaea9afdcd] succeeded in 1.1612642139989475s: None 2024-02-23T04:36:01.945608598Z [2024-02-23 04:36:01,945: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dbe1fb2c-de63-4360-a306-cbf71db2deb3] succeeded in 1.6330239979979524s: None 2024-02-23T04:36:02.009252827Z [2024-02-23 04:36:02,008: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:36:02.012896744Z [2024-02-23 04:36:02,012: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:36:02.034579044Z [2024-02-23 04:36:02,034: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:36:02.038229580Z [2024-02-23 04:36:02,037: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:36:02.038403405Z [2024-02-23 04:36:02,038: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:36:02.038580213Z [2024-02-23 04:36:02,038: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:36:02.038681767Z [2024-02-23 04:36:02,038: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:36:02.039129953Z [2024-02-23 04:36:02,038: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:36:02.039190270Z [2024-02-23 04:36:02,039: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:36:02.132665109Z [2024-02-23 04:36:02,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:36:02.205009066Z [2024-02-23 04:36:02,204: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:36:02.208701419Z [2024-02-23 04:36:02,208: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:36:02.244087582Z [2024-02-23 04:36:02,243: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:36:02.246322738Z [2024-02-23 04:36:02,245: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:36:02.246634612Z [2024-02-23 04:36:02,246: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:36:02.246967823Z [2024-02-23 04:36:02,246: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:36:02.247166800Z [2024-02-23 04:36:02,246: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:36:02.247590237Z [2024-02-23 04:36:02,247: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:36:02.248393006Z [2024-02-23 04:36:02,247: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:36:02.335637195Z [2024-02-23 04:36:02,335: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:36:03.572925509Z [2024-02-23 04:36:03,572: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f76cf27e-c724-4186-aaca-a4cf25a3859f] succeeded in 3.264705129000504s: None 2024-02-23T04:36:04.695810014Z [2024-02-23 04:36:04,695: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2ffc2d8-5741-4024-b0b3-08bafcb39ad3] succeeded in 4.390671671000746s: None 2024-02-23T04:36:28.500275303Z [2024-02-23 04:36:28,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ef3bae5-f0d2-4610-ac6c-3ecc20636bff] received 2024-02-23T04:36:28.512146410Z [2024-02-23 04:36:28,511: INFO/ForkPoolWorker-15] [3ef3bae5-f0d2-4610-ac6c-3ecc20636bff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223043627_157275', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:36:28.832713423Z [2024-02-23 04:36:28,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:36:29.168343810Z [2024-02-23 04:36:29,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:36:29.830366797Z [2024-02-23 04:36:29,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ef3bae5-f0d2-4610-ac6c-3ecc20636bff] succeeded in 1.3283304850010609s: None 2024-02-23T04:37:00.967000475Z [2024-02-23 04:37:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcbb1596-d72b-4e1a-ba53-d9c4e9bf18a5] received 2024-02-23T04:37:00.968701437Z [2024-02-23 04:37:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75a39508-35eb-4b59-82ae-7339560d9280] received 2024-02-23T04:37:00.975937738Z [2024-02-23 04:37:00,975: INFO/ForkPoolWorker-15] [fcbb1596-d72b-4e1a-ba53-d9c4e9bf18a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:37:00.976388760Z [2024-02-23 04:37:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[004ff6d0-3a24-4692-ab30-6515ee81d5d6] received 2024-02-23T04:37:00.981184172Z [2024-02-23 04:37:00,980: INFO/ForkPoolWorker-16] [75a39508-35eb-4b59-82ae-7339560d9280] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:37:00.990548215Z [2024-02-23 04:37:00,990: INFO/ForkPoolWorker-1] [004ff6d0-3a24-4692-ab30-6515ee81d5d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:37:01.302401638Z [2024-02-23 04:37:01,298: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:37:01.307733984Z [2024-02-23 04:37:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:37:01.324560039Z [2024-02-23 04:37:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:37:01.475522820Z [2024-02-23 04:37:01,475: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:37:01.479615415Z [2024-02-23 04:37:01,479: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:37:01.506744074Z [2024-02-23 04:37:01,506: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:37:01.507790643Z [2024-02-23 04:37:01,507: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:37:01.507892691Z [2024-02-23 04:37:01,507: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:37:01.508081317Z [2024-02-23 04:37:01,507: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:37:01.508599038Z [2024-02-23 04:37:01,508: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:37:01.641264442Z [2024-02-23 04:37:01,640: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:37:02.356029097Z [2024-02-23 04:37:02,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75a39508-35eb-4b59-82ae-7339560d9280] succeeded in 1.3856353289993422s: None 2024-02-23T04:37:02.706661485Z [2024-02-23 04:37:02,706: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:37:02.710335999Z [2024-02-23 04:37:02,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:37:02.732985303Z [2024-02-23 04:37:02,732: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:37:02.734429102Z [2024-02-23 04:37:02,734: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:37:02.734542647Z [2024-02-23 04:37:02,734: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:37:02.734726136Z [2024-02-23 04:37:02,734: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:37:02.734853133Z [2024-02-23 04:37:02,734: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:37:02.735311847Z [2024-02-23 04:37:02,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:37:02.735427845Z [2024-02-23 04:37:02,735: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:37:02.744950574Z [2024-02-23 04:37:02,744: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:37:02.751400703Z [2024-02-23 04:37:02,750: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:37:02.780999633Z [2024-02-23 04:37:02,780: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:37:02.782604627Z [2024-02-23 04:37:02,782: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:37:02.782627209Z [2024-02-23 04:37:02,782: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:37:02.782806880Z [2024-02-23 04:37:02,782: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:37:02.782874099Z [2024-02-23 04:37:02,782: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:37:02.783172567Z [2024-02-23 04:37:02,783: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:37:02.783333476Z [2024-02-23 04:37:02,783: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:37:02.831479494Z [2024-02-23 04:37:02,831: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:37:02.886314592Z [2024-02-23 04:37:02,885: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:37:06.391906035Z [2024-02-23 04:37:06,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcbb1596-d72b-4e1a-ba53-d9c4e9bf18a5] succeeded in 5.423514449001232s: None 2024-02-23T04:37:07.348979248Z [2024-02-23 04:37:07,348: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[004ff6d0-3a24-4692-ab30-6515ee81d5d6] succeeded in 6.370637487001659s: None 2024-02-23T04:38:01.212294868Z [2024-02-23 04:38:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eca96be5-ac97-4579-a75a-09eceb146da3] received 2024-02-23T04:38:01.216340419Z [2024-02-23 04:38:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89901043-93d6-4694-aad0-a98c27529e11] received 2024-02-23T04:38:01.228511253Z [2024-02-23 04:38:01,228: INFO/ForkPoolWorker-15] [eca96be5-ac97-4579-a75a-09eceb146da3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:38:01.229049460Z [2024-02-23 04:38:01,228: INFO/ForkPoolWorker-16] [89901043-93d6-4694-aad0-a98c27529e11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:38:01.234092411Z [2024-02-23 04:38:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26fee5cb-91bd-4934-b622-1571e30f8ed0] received 2024-02-23T04:38:01.237757626Z [2024-02-23 04:38:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84a54273-8a03-49b9-95f7-20f775b69552] received 2024-02-23T04:38:01.245372657Z [2024-02-23 04:38:01,244: INFO/ForkPoolWorker-1] [26fee5cb-91bd-4934-b622-1571e30f8ed0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:38:01.247547937Z [2024-02-23 04:38:01,247: INFO/ForkPoolWorker-2] [84a54273-8a03-49b9-95f7-20f775b69552] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:38:01.526867219Z [2024-02-23 04:38:01,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:38:01.580339700Z [2024-02-23 04:38:01,576: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:38:01.640494308Z [2024-02-23 04:38:01,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:38:01.696408648Z [2024-02-23 04:38:01,692: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:38:01.766791060Z [2024-02-23 04:38:01,766: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:38:01.771103914Z [2024-02-23 04:38:01,770: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:38:01.806691534Z [2024-02-23 04:38:01,806: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:38:01.808223364Z [2024-02-23 04:38:01,808: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:38:01.808450884Z [2024-02-23 04:38:01,808: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:38:01.808605832Z [2024-02-23 04:38:01,808: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:38:01.808894319Z [2024-02-23 04:38:01,808: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:38:01.943627643Z [2024-02-23 04:38:01,943: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:38:01.966659484Z [2024-02-23 04:38:01,966: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:38:02.573219863Z [2024-02-23 04:38:02,572: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[84a54273-8a03-49b9-95f7-20f775b69552] succeeded in 1.3330323440022767s: None 2024-02-23T04:38:02.623829653Z [2024-02-23 04:38:02,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eca96be5-ac97-4579-a75a-09eceb146da3] succeeded in 1.4057011819968466s: None 2024-02-23T04:38:02.953478695Z [2024-02-23 04:38:02,953: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:38:02.957065691Z [2024-02-23 04:38:02,956: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:38:02.984719690Z [2024-02-23 04:38:02,984: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:38:02.986496094Z [2024-02-23 04:38:02,986: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:38:02.986540648Z [2024-02-23 04:38:02,986: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:38:02.986774268Z [2024-02-23 04:38:02,986: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:38:02.986921707Z [2024-02-23 04:38:02,986: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:38:02.987668436Z [2024-02-23 04:38:02,987: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:38:02.988154133Z [2024-02-23 04:38:02,987: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:38:03.067646990Z [2024-02-23 04:38:03,067: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:38:03.071292643Z [2024-02-23 04:38:03,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:38:03.101270669Z [2024-02-23 04:38:03,101: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:38:03.103671888Z [2024-02-23 04:38:03,103: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:38:03.103953575Z [2024-02-23 04:38:03,103: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:38:03.111431723Z [2024-02-23 04:38:03,111: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:38:03.111620683Z [2024-02-23 04:38:03,111: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:38:03.112179876Z [2024-02-23 04:38:03,111: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:38:03.112926763Z [2024-02-23 04:38:03,112: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:38:03.115939773Z [2024-02-23 04:38:03,115: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:38:03.201761161Z [2024-02-23 04:38:03,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:38:05.095365656Z [2024-02-23 04:38:05,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26fee5cb-91bd-4934-b622-1571e30f8ed0] succeeded in 3.858407805000752s: None 2024-02-23T04:38:05.145806378Z [2024-02-23 04:38:05,145: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89901043-93d6-4694-aad0-a98c27529e11] succeeded in 3.923665970000002s: None 2024-02-23T04:39:00.396599812Z [2024-02-23 04:39:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39fe67e2-01a4-494e-851a-42856d54bab6] received 2024-02-23T04:39:00.401244587Z [2024-02-23 04:39:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d6dc482-6d08-46e4-b1f7-72154be376a8] received 2024-02-23T04:39:00.410100188Z [2024-02-23 04:39:00,409: INFO/ForkPoolWorker-15] [39fe67e2-01a4-494e-851a-42856d54bab6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:39:00.411925698Z [2024-02-23 04:39:00,411: INFO/ForkPoolWorker-16] [6d6dc482-6d08-46e4-b1f7-72154be376a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:39:00.417336702Z [2024-02-23 04:39:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08322dbe-4a12-4d4a-98a7-549adf477b1c] received 2024-02-23T04:39:00.424502979Z [2024-02-23 04:39:00,424: INFO/ForkPoolWorker-1] [08322dbe-4a12-4d4a-98a7-549adf477b1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:39:00.734794563Z [2024-02-23 04:39:00,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:39:00.752649697Z [2024-02-23 04:39:00,749: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:39:00.801827266Z [2024-02-23 04:39:00,798: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:39:00.931993852Z [2024-02-23 04:39:00,931: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:39:00.936581316Z [2024-02-23 04:39:00,936: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:39:00.965233839Z [2024-02-23 04:39:00,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:39:00.966637782Z [2024-02-23 04:39:00,966: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:39:00.966791571Z [2024-02-23 04:39:00,966: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:39:00.966943896Z [2024-02-23 04:39:00,966: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:39:00.967251731Z [2024-02-23 04:39:00,967: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:39:01.089679931Z [2024-02-23 04:39:01,089: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:39:01.671188323Z [2024-02-23 04:39:01,670: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d6dc482-6d08-46e4-b1f7-72154be376a8] succeeded in 1.2658252789988182s: None 2024-02-23T04:39:01.908943187Z [2024-02-23 04:39:01,908: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:39:01.912105764Z [2024-02-23 04:39:01,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:39:01.933957236Z [2024-02-23 04:39:01,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:39:01.935822560Z [2024-02-23 04:39:01,935: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:39:01.935844631Z [2024-02-23 04:39:01,935: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:39:01.936069057Z [2024-02-23 04:39:01,935: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:39:01.936120561Z [2024-02-23 04:39:01,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:39:01.936384094Z [2024-02-23 04:39:01,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:39:01.936400014Z [2024-02-23 04:39:01,936: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:39:02.022178172Z [2024-02-23 04:39:02,021: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:39:02.025577123Z [2024-02-23 04:39:02,025: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:39:02.031689117Z [2024-02-23 04:39:02,031: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:39:02.055982773Z [2024-02-23 04:39:02,055: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:39:02.057470314Z [2024-02-23 04:39:02,057: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:39:02.057687425Z [2024-02-23 04:39:02,057: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:39:02.057942278Z [2024-02-23 04:39:02,057: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:39:02.058226475Z [2024-02-23 04:39:02,058: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:39:02.058744301Z [2024-02-23 04:39:02,058: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:39:02.058977700Z [2024-02-23 04:39:02,058: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:39:02.144059583Z [2024-02-23 04:39:02,143: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:39:03.720395813Z [2024-02-23 04:39:03,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08322dbe-4a12-4d4a-98a7-549adf477b1c] succeeded in 3.3005462839973916s: None 2024-02-23T04:39:03.950582661Z [2024-02-23 04:39:03,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39fe67e2-01a4-494e-851a-42856d54bab6] succeeded in 3.547539858998789s: None 2024-02-23T04:40:01.122643431Z [2024-02-23 04:40:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08141877-aefa-404b-a3fa-7a00055d07b7] received 2024-02-23T04:40:01.127081544Z [2024-02-23 04:40:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74704c0a-492e-4afc-8ea4-24215d4a63ff] received 2024-02-23T04:40:01.133213180Z [2024-02-23 04:40:01,132: INFO/ForkPoolWorker-15] [08141877-aefa-404b-a3fa-7a00055d07b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:40:01.135380780Z [2024-02-23 04:40:01,135: INFO/ForkPoolWorker-16] [74704c0a-492e-4afc-8ea4-24215d4a63ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:40:01.139271633Z [2024-02-23 04:40:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0e142ec-829d-442f-bf92-4473d30d1bed] received 2024-02-23T04:40:01.141325600Z [2024-02-23 04:40:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18566522-9e11-4df7-90ca-78092933b29f] received 2024-02-23T04:40:01.143162358Z [2024-02-23 04:40:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07a301d9-9b35-4cc4-a8f9-ea22ea9dcf8e] received 2024-02-23T04:40:01.150109624Z [2024-02-23 04:40:01,149: INFO/ForkPoolWorker-1] [e0e142ec-829d-442f-bf92-4473d30d1bed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:40:01.156702393Z [2024-02-23 04:40:01,156: INFO/ForkPoolWorker-2] [18566522-9e11-4df7-90ca-78092933b29f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:40:01.159318262Z [2024-02-23 04:40:01,158: INFO/ForkPoolWorker-3] [07a301d9-9b35-4cc4-a8f9-ea22ea9dcf8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:40:01.509665860Z [2024-02-23 04:40:01,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:40:01.569451626Z [2024-02-23 04:40:01,565: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:40:01.574583312Z [2024-02-23 04:40:01,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:40:01.631865505Z [2024-02-23 04:40:01,628: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:40:01.853942722Z [2024-02-23 04:40:01,850: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:40:01.934550705Z [2024-02-23 04:40:01,934: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:02.106810880Z [2024-02-23 04:40:02,106: INFO/ForkPoolWorker-3] Getting SDNC list 2024-02-23T04:40:02.112537173Z [2024-02-23 04:40:02,112: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:02.164190898Z [2024-02-23 04:40:02,163: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T04:40:02.168292221Z [2024-02-23 04:40:02,168: INFO/ForkPoolWorker-3] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:40:02.168387009Z [2024-02-23 04:40:02,168: INFO/ForkPoolWorker-3] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:40:02.168413965Z [2024-02-23 04:40:02,168: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-02-23T04:40:02.168696639Z [2024-02-23 04:40:02,168: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:40:02.306635918Z [2024-02-23 04:40:02,306: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:02.802750174Z [2024-02-23 04:40:02,802: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74704c0a-492e-4afc-8ea4-24215d4a63ff] succeeded in 1.672949431998859s: None 2024-02-23T04:40:03.357558869Z [2024-02-23 04:40:03,357: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:40:03.361637242Z [2024-02-23 04:40:03,361: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:03.431946076Z [2024-02-23 04:40:03,431: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:40:03.432906285Z [2024-02-23 04:40:03,432: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[07a301d9-9b35-4cc4-a8f9-ea22ea9dcf8e] succeeded in 2.2879550450015813s: None 2024-02-23T04:40:03.436191456Z [2024-02-23 04:40:03,435: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:40:03.436456927Z [2024-02-23 04:40:03,436: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:40:03.436848324Z [2024-02-23 04:40:03,436: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:40:03.436972987Z [2024-02-23 04:40:03,436: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:40:03.437310438Z [2024-02-23 04:40:03,437: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:40:03.437455780Z [2024-02-23 04:40:03,437: INFO/ForkPoolWorker-2] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:40:03.471569913Z [2024-02-23 04:40:03,471: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:40:03.475181743Z [2024-02-23 04:40:03,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:03.524104295Z [2024-02-23 04:40:03,523: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:03.525764149Z [2024-02-23 04:40:03,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:40:03.530581216Z [2024-02-23 04:40:03,530: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:40:03.530693447Z [2024-02-23 04:40:03,530: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:40:03.530774800Z [2024-02-23 04:40:03,530: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:40:03.530801953Z [2024-02-23 04:40:03,530: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:40:03.535156413Z [2024-02-23 04:40:03,530: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:40:03.535443555Z [2024-02-23 04:40:03,535: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:40:03.658554407Z [2024-02-23 04:40:03,658: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:40:03.666945443Z [2024-02-23 04:40:03,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:03.690471403Z [2024-02-23 04:40:03,690: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:03.724252545Z [2024-02-23 04:40:03,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:40:03.727784050Z [2024-02-23 04:40:03,727: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:40:03.727827453Z [2024-02-23 04:40:03,727: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:40:03.727855363Z [2024-02-23 04:40:03,727: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:40:03.727883684Z [2024-02-23 04:40:03,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:40:03.735679055Z [2024-02-23 04:40:03,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:40:03.739503192Z [2024-02-23 04:40:03,735: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:40:03.856084131Z [2024-02-23 04:40:03,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:04.597491318Z [2024-02-23 04:40:04,597: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08141877-aefa-404b-a3fa-7a00055d07b7] succeeded in 3.472086802001286s: None 2024-02-23T04:40:04.968407817Z [2024-02-23 04:40:04,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fca4fac-ddc7-4434-96ab-d4b30c90aa2b] received 2024-02-23T04:40:04.975715965Z [2024-02-23 04:40:04,975: INFO/ForkPoolWorker-15] [3fca4fac-ddc7-4434-96ab-d4b30c90aa2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:40:05.292459255Z [2024-02-23 04:40:05,289: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:40:05.383143243Z [2024-02-23 04:40:05,381: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[18566522-9e11-4df7-90ca-78092933b29f] succeeded in 4.237619083000027s: None 2024-02-23T04:40:06.469015338Z [2024-02-23 04:40:06,468: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:40:06.472294917Z [2024-02-23 04:40:06,471: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:06.492356595Z [2024-02-23 04:40:06,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:40:06.493653699Z [2024-02-23 04:40:06,493: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:40:06.493731381Z [2024-02-23 04:40:06,493: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:40:06.493901908Z [2024-02-23 04:40:06,493: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:40:06.493984786Z [2024-02-23 04:40:06,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:40:06.494310673Z [2024-02-23 04:40:06,494: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:40:06.494406918Z [2024-02-23 04:40:06,494: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:40:06.584963264Z [2024-02-23 04:40:06,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:06.799516235Z [2024-02-23 04:40:06,799: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0e142ec-829d-442f-bf92-4473d30d1bed] succeeded in 5.657021546998294s: None 2024-02-23T04:40:07.294042236Z [2024-02-23 04:40:07,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3fca4fac-ddc7-4434-96ab-d4b30c90aa2b] succeeded in 2.323520991998521s: None 2024-02-23T04:40:07.456073327Z [2024-02-23 04:40:07,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56430247-0881-4cc1-a3d3-ce6bfe59f077] received 2024-02-23T04:40:07.463997378Z [2024-02-23 04:40:07,463: INFO/ForkPoolWorker-15] [56430247-0881-4cc1-a3d3-ce6bfe59f077] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:40:07.744558341Z [2024-02-23 04:40:07,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:40:08.913646054Z [2024-02-23 04:40:08,913: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:40:08.916877894Z [2024-02-23 04:40:08,916: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:08.933974010Z [2024-02-23 04:40:08,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:40:08.935537188Z [2024-02-23 04:40:08,935: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:40:08.935553831Z [2024-02-23 04:40:08,935: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:40:08.935623449Z [2024-02-23 04:40:08,935: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:40:08.935637069Z [2024-02-23 04:40:08,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:40:08.935909597Z [2024-02-23 04:40:08,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:40:08.935919985Z [2024-02-23 04:40:08,935: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:40:09.038167265Z [2024-02-23 04:40:09,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:09.707261512Z [2024-02-23 04:40:09,706: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56430247-0881-4cc1-a3d3-ce6bfe59f077] succeeded in 2.2484437080020143s: None 2024-02-23T04:40:10.159545008Z [2024-02-23 04:40:10,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b1cc3d2-5249-401d-8449-27880a62cd65] received 2024-02-23T04:40:10.168550182Z [2024-02-23 04:40:10,168: INFO/ForkPoolWorker-15] [7b1cc3d2-5249-401d-8449-27880a62cd65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:40:10.471238926Z [2024-02-23 04:40:10,468: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:40:11.583142913Z [2024-02-23 04:40:11,582: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:40:11.586357627Z [2024-02-23 04:40:11,585: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:40:11.610990809Z [2024-02-23 04:40:11,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:40:11.612711226Z [2024-02-23 04:40:11,612: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:40:11.612760385Z [2024-02-23 04:40:11,612: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:40:11.612964722Z [2024-02-23 04:40:11,612: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:40:11.613126228Z [2024-02-23 04:40:11,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:40:11.613561758Z [2024-02-23 04:40:11,613: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:40:11.613690652Z [2024-02-23 04:40:11,613: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:40:11.711193229Z [2024-02-23 04:40:11,710: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:40:12.360458182Z [2024-02-23 04:40:12,359: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b1cc3d2-5249-401d-8449-27880a62cd65] succeeded in 2.198335993998626s: None 2024-02-23T04:41:00.958513421Z [2024-02-23 04:41:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f1d05fe-25a8-47c3-8e41-1394b9c9e69f] received 2024-02-23T04:41:00.966564490Z [2024-02-23 04:41:00,965: INFO/ForkPoolWorker-15] [8f1d05fe-25a8-47c3-8e41-1394b9c9e69f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:41:00.969253414Z [2024-02-23 04:41:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[027a3e99-e60c-4acf-84b7-69f32dbe8f8c] received 2024-02-23T04:41:00.975050241Z [2024-02-23 04:41:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb27840e-d185-46aa-8f17-d62899832ff8] received 2024-02-23T04:41:00.976599188Z [2024-02-23 04:41:00,976: INFO/ForkPoolWorker-16] [027a3e99-e60c-4acf-84b7-69f32dbe8f8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:41:00.988456264Z [2024-02-23 04:41:00,988: INFO/ForkPoolWorker-1] [bb27840e-d185-46aa-8f17-d62899832ff8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:41:01.281271135Z [2024-02-23 04:41:01,278: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:41:01.330793852Z [2024-02-23 04:41:01,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:41:01.377624452Z [2024-02-23 04:41:01,373: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:41:01.475205389Z [2024-02-23 04:41:01,473: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:41:01.478061871Z [2024-02-23 04:41:01,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:41:01.507543240Z [2024-02-23 04:41:01,507: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:41:01.514418319Z [2024-02-23 04:41:01,514: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:41:01.514550322Z [2024-02-23 04:41:01,514: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:41:01.514643417Z [2024-02-23 04:41:01,514: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:41:01.514985655Z [2024-02-23 04:41:01,514: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:41:01.615419751Z [2024-02-23 04:41:01,615: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:41:02.459345719Z [2024-02-23 04:41:02,458: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[027a3e99-e60c-4acf-84b7-69f32dbe8f8c] succeeded in 1.4878031999978703s: None 2024-02-23T04:41:02.978644344Z [2024-02-23 04:41:02,978: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:41:02.982317149Z [2024-02-23 04:41:02,981: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:41:02.994906700Z [2024-02-23 04:41:02,994: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:41:02.998620838Z [2024-02-23 04:41:02,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:41:03.014958401Z [2024-02-23 04:41:03,014: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:41:03.016386121Z [2024-02-23 04:41:03,016: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:41:03.016428421Z [2024-02-23 04:41:03,016: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:41:03.016540804Z [2024-02-23 04:41:03,016: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:41:03.016570839Z [2024-02-23 04:41:03,016: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:41:03.016845056Z [2024-02-23 04:41:03,016: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:41:03.016852810Z [2024-02-23 04:41:03,016: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:41:03.029761365Z [2024-02-23 04:41:03,029: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:41:03.031694228Z [2024-02-23 04:41:03,031: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:41:03.031711672Z [2024-02-23 04:41:03,031: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:41:03.031814279Z [2024-02-23 04:41:03,031: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:41:03.031862154Z [2024-02-23 04:41:03,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:41:03.032057312Z [2024-02-23 04:41:03,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:41:03.032089826Z [2024-02-23 04:41:03,032: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:41:03.160950694Z [2024-02-23 04:41:03,160: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:41:03.165954363Z [2024-02-23 04:41:03,165: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:41:05.704123825Z [2024-02-23 04:41:05,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb27840e-d185-46aa-8f17-d62899832ff8] succeeded in 4.727266593999957s: None 2024-02-23T04:41:06.762753178Z [2024-02-23 04:41:06,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f1d05fe-25a8-47c3-8e41-1394b9c9e69f] succeeded in 5.801532731999032s: None 2024-02-23T04:42:00.257039694Z [2024-02-23 04:42:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbd953fb-dda5-4601-b592-77f48ae5f470] received 2024-02-23T04:42:00.261690619Z [2024-02-23 04:42:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13cfbcf1-fe5f-4313-95f7-662fb719d17e] received 2024-02-23T04:42:00.268998705Z [2024-02-23 04:42:00,268: INFO/ForkPoolWorker-16] [13cfbcf1-fe5f-4313-95f7-662fb719d17e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:42:00.269871030Z [2024-02-23 04:42:00,269: INFO/ForkPoolWorker-15] [fbd953fb-dda5-4601-b592-77f48ae5f470] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:42:00.285113289Z [2024-02-23 04:42:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3750d52c-fe48-4d0d-91a4-7c4ec57ecab8] received 2024-02-23T04:42:00.288483067Z [2024-02-23 04:42:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be4a85e0-8df0-4cdb-b462-26b7eb634f0c] received 2024-02-23T04:42:00.297968351Z [2024-02-23 04:42:00,297: INFO/ForkPoolWorker-2] [be4a85e0-8df0-4cdb-b462-26b7eb634f0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:42:00.298773869Z [2024-02-23 04:42:00,298: INFO/ForkPoolWorker-1] [3750d52c-fe48-4d0d-91a4-7c4ec57ecab8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:42:00.582276234Z [2024-02-23 04:42:00,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:42:00.604184132Z [2024-02-23 04:42:00,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:42:00.673014686Z [2024-02-23 04:42:00,669: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:42:00.884700198Z [2024-02-23 04:42:00,879: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:42:01.087998771Z [2024-02-23 04:42:01,087: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:42:01.088684505Z [2024-02-23 04:42:01,088: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:42:01.092937307Z [2024-02-23 04:42:01,092: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:42:01.119557035Z [2024-02-23 04:42:01,119: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:42:01.120515368Z [2024-02-23 04:42:01,120: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:42:01.120622906Z [2024-02-23 04:42:01,120: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:42:01.121074144Z [2024-02-23 04:42:01,120: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:42:01.121479127Z [2024-02-23 04:42:01,121: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:42:01.207131709Z [2024-02-23 04:42:01,206: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:42:01.706221629Z [2024-02-23 04:42:01,705: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbd953fb-dda5-4601-b592-77f48ae5f470] succeeded in 1.4471410719997948s: None 2024-02-23T04:42:01.863853511Z [2024-02-23 04:42:01,863: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[be4a85e0-8df0-4cdb-b462-26b7eb634f0c] succeeded in 1.572521041998698s: None 2024-02-23T04:42:02.048407973Z [2024-02-23 04:42:02,048: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:42:02.051572354Z [2024-02-23 04:42:02,051: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:42:02.068739834Z [2024-02-23 04:42:02,068: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:42:02.072654924Z [2024-02-23 04:42:02,072: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:42:02.075952497Z [2024-02-23 04:42:02,075: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:42:02.078819978Z [2024-02-23 04:42:02,078: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:42:02.078955823Z [2024-02-23 04:42:02,078: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:42:02.079034195Z [2024-02-23 04:42:02,078: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:42:02.079057207Z [2024-02-23 04:42:02,078: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:42:02.079432600Z [2024-02-23 04:42:02,079: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:42:02.079454694Z [2024-02-23 04:42:02,079: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:42:02.095185090Z [2024-02-23 04:42:02,094: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:42:02.097924497Z [2024-02-23 04:42:02,097: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:42:02.098081852Z [2024-02-23 04:42:02,097: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:42:02.098284109Z [2024-02-23 04:42:02,098: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:42:02.098384893Z [2024-02-23 04:42:02,098: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:42:02.098659326Z [2024-02-23 04:42:02,098: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:42:02.098809446Z [2024-02-23 04:42:02,098: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:42:02.184624083Z [2024-02-23 04:42:02,182: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:42:02.207708323Z [2024-02-23 04:42:02,207: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:42:03.960567396Z [2024-02-23 04:42:03,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3750d52c-fe48-4d0d-91a4-7c4ec57ecab8] succeeded in 3.670715977998043s: None 2024-02-23T04:42:04.381142218Z [2024-02-23 04:42:04,380: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13cfbcf1-fe5f-4313-95f7-662fb719d17e] succeeded in 4.116833479998604s: None 2024-02-23T04:42:28.724325699Z [2024-02-23 04:42:28,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6a38ad1-ec96-4c25-962b-47009c4b52b6] received 2024-02-23T04:42:28.735234421Z [2024-02-23 04:42:28,734: INFO/ForkPoolWorker-15] [c6a38ad1-ec96-4c25-962b-47009c4b52b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223044227_847075', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:42:29.097394943Z [2024-02-23 04:42:29,094: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:42:29.405387673Z [2024-02-23 04:42:29,405: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:42:30.127914599Z [2024-02-23 04:42:30,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6a38ad1-ec96-4c25-962b-47009c4b52b6] succeeded in 1.4011127029989439s: None 2024-02-23T04:43:00.313695349Z [2024-02-23 04:43:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e17aab09-8707-4df8-bda0-437ddef71bd7] received 2024-02-23T04:43:00.315408285Z [2024-02-23 04:43:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f16093e-52bb-4ebf-999e-2d1d4353e6ce] received 2024-02-23T04:43:00.320659410Z [2024-02-23 04:43:00,320: INFO/ForkPoolWorker-15] [e17aab09-8707-4df8-bda0-437ddef71bd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:43:00.325680765Z [2024-02-23 04:43:00,325: INFO/ForkPoolWorker-16] [0f16093e-52bb-4ebf-999e-2d1d4353e6ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:43:00.332896111Z [2024-02-23 04:43:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fae12a66-ac9c-44c5-b395-6bc61b0b4832] received 2024-02-23T04:43:00.342254143Z [2024-02-23 04:43:00,341: INFO/ForkPoolWorker-1] [fae12a66-ac9c-44c5-b395-6bc61b0b4832] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:43:00.631705945Z [2024-02-23 04:43:00,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:43:00.651047158Z [2024-02-23 04:43:00,648: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:43:00.721011806Z [2024-02-23 04:43:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:43:00.885608852Z [2024-02-23 04:43:00,885: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:43:00.889769218Z [2024-02-23 04:43:00,889: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:43:00.915898528Z [2024-02-23 04:43:00,915: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:43:00.917794159Z [2024-02-23 04:43:00,917: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:43:00.918171755Z [2024-02-23 04:43:00,917: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:43:00.918456876Z [2024-02-23 04:43:00,918: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:43:00.919010654Z [2024-02-23 04:43:00,918: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:43:01.022020425Z [2024-02-23 04:43:01,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:43:01.654306693Z [2024-02-23 04:43:01,653: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fae12a66-ac9c-44c5-b395-6bc61b0b4832] succeeded in 1.3186132119990361s: None 2024-02-23T04:43:01.813676540Z [2024-02-23 04:43:01,813: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:43:01.816463505Z [2024-02-23 04:43:01,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:43:01.816763907Z [2024-02-23 04:43:01,816: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:43:01.820681861Z [2024-02-23 04:43:01,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:43:01.843669664Z [2024-02-23 04:43:01,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:43:01.845641075Z [2024-02-23 04:43:01,845: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:43:01.845669572Z [2024-02-23 04:43:01,845: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:43:01.845848328Z [2024-02-23 04:43:01,845: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:43:01.845867317Z [2024-02-23 04:43:01,845: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:43:01.847422257Z [2024-02-23 04:43:01,847: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:43:01.847908699Z [2024-02-23 04:43:01,847: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:43:01.852150566Z [2024-02-23 04:43:01,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:43:01.854266404Z [2024-02-23 04:43:01,853: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:43:01.854442300Z [2024-02-23 04:43:01,854: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:43:01.854646646Z [2024-02-23 04:43:01,854: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:43:01.854749512Z [2024-02-23 04:43:01,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:43:01.855273727Z [2024-02-23 04:43:01,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:43:01.855377958Z [2024-02-23 04:43:01,855: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:43:01.925858572Z [2024-02-23 04:43:01,925: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:43:01.956210437Z [2024-02-23 04:43:01,955: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:43:03.480749504Z [2024-02-23 04:43:03,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e17aab09-8707-4df8-bda0-437ddef71bd7] succeeded in 3.165592043998913s: None 2024-02-23T04:43:03.900389689Z [2024-02-23 04:43:03,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f16093e-52bb-4ebf-999e-2d1d4353e6ce] succeeded in 3.582571163002285s: None 2024-02-23T04:44:00.229981472Z [2024-02-23 04:44:00,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5877fcd7-46e5-414a-a873-c2841e583de8] received 2024-02-23T04:44:00.236587540Z [2024-02-23 04:44:00,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fea0092-6f4f-4eb3-b24f-817760fdde24] received 2024-02-23T04:44:00.244983963Z [2024-02-23 04:44:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[465bb19f-473b-4e69-a593-cf9596df0da3] received 2024-02-23T04:44:00.248231546Z [2024-02-23 04:44:00,248: INFO/ForkPoolWorker-15] [5877fcd7-46e5-414a-a873-c2841e583de8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:44:00.251083097Z [2024-02-23 04:44:00,250: INFO/ForkPoolWorker-1] [465bb19f-473b-4e69-a593-cf9596df0da3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:44:00.256183593Z [2024-02-23 04:44:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c72e09f-0947-472c-9c7c-e8e36e0445f2] received 2024-02-23T04:44:00.266325270Z [2024-02-23 04:44:00,266: INFO/ForkPoolWorker-16] [4fea0092-6f4f-4eb3-b24f-817760fdde24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:44:00.267667337Z [2024-02-23 04:44:00,267: INFO/ForkPoolWorker-2] [9c72e09f-0947-472c-9c7c-e8e36e0445f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:44:00.547558131Z [2024-02-23 04:44:00,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:44:00.591725115Z [2024-02-23 04:44:00,588: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:44:00.652971125Z [2024-02-23 04:44:00,649: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:44:00.665256507Z [2024-02-23 04:44:00,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:44:00.774242774Z [2024-02-23 04:44:00,773: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:44:00.778880860Z [2024-02-23 04:44:00,778: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:44:00.827848026Z [2024-02-23 04:44:00,827: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:44:00.829967539Z [2024-02-23 04:44:00,829: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:44:00.831180692Z [2024-02-23 04:44:00,829: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:44:00.831419057Z [2024-02-23 04:44:00,831: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:44:00.831742586Z [2024-02-23 04:44:00,831: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:44:00.880165560Z [2024-02-23 04:44:00,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:44:00.967734060Z [2024-02-23 04:44:00,967: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:44:01.632892805Z [2024-02-23 04:44:01,632: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9c72e09f-0947-472c-9c7c-e8e36e0445f2] succeeded in 1.3744948169987765s: None 2024-02-23T04:44:01.633428073Z [2024-02-23 04:44:01,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5877fcd7-46e5-414a-a873-c2841e583de8] succeeded in 1.3978330700010702s: None 2024-02-23T04:44:01.917980074Z [2024-02-23 04:44:01,917: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:44:01.921253829Z [2024-02-23 04:44:01,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:44:01.949865464Z [2024-02-23 04:44:01,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:44:01.951357615Z [2024-02-23 04:44:01,951: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:44:01.951372552Z [2024-02-23 04:44:01,951: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:44:01.951480394Z [2024-02-23 04:44:01,951: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:44:01.951505019Z [2024-02-23 04:44:01,951: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:44:01.951744363Z [2024-02-23 04:44:01,951: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:44:01.951787647Z [2024-02-23 04:44:01,951: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:44:02.073723332Z [2024-02-23 04:44:02,073: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:44:02.111691789Z [2024-02-23 04:44:02,111: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:44:02.115269946Z [2024-02-23 04:44:02,114: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:44:02.142636761Z [2024-02-23 04:44:02,142: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:44:02.144085174Z [2024-02-23 04:44:02,143: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:44:02.144193070Z [2024-02-23 04:44:02,144: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:44:02.144367397Z [2024-02-23 04:44:02,144: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:44:02.144446535Z [2024-02-23 04:44:02,144: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:44:02.144705905Z [2024-02-23 04:44:02,144: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:44:02.144824628Z [2024-02-23 04:44:02,144: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:44:02.228660910Z [2024-02-23 04:44:02,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:44:03.642694206Z [2024-02-23 04:44:03,642: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[465bb19f-473b-4e69-a593-cf9596df0da3] succeeded in 3.396376414999395s: None 2024-02-23T04:44:04.221511550Z [2024-02-23 04:44:04,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fea0092-6f4f-4eb3-b24f-817760fdde24] succeeded in 3.983572870001808s: None 2024-02-23T04:44:28.680226437Z [2024-02-23 04:44:28,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74dcf0a6-f634-404c-bfdd-7d825bc1643d] received 2024-02-23T04:44:28.691534277Z [2024-02-23 04:44:28,691: INFO/ForkPoolWorker-15] [74dcf0a6-f634-404c-bfdd-7d825bc1643d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223044427_232249', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:44:28.963869759Z [2024-02-23 04:44:28,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:44:29.332882564Z [2024-02-23 04:44:29,332: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:44:30.063145477Z [2024-02-23 04:44:30,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74dcf0a6-f634-404c-bfdd-7d825bc1643d] succeeded in 1.3805757250011084s: None 2024-02-23T04:45:01.210172846Z [2024-02-23 04:45:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7a4cd5b-3ca3-488d-b1be-9705d651695e] received 2024-02-23T04:45:01.212942608Z [2024-02-23 04:45:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84c715ac-0bf6-495f-9d71-f7aac57796aa] received 2024-02-23T04:45:01.215749168Z [2024-02-23 04:45:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[993569d4-e415-44da-9c70-bfea75e54ccf] received 2024-02-23T04:45:01.218427656Z [2024-02-23 04:45:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[693a4019-6546-4069-9a66-d9beeafe0c4e] received 2024-02-23T04:45:01.222177894Z [2024-02-23 04:45:01,221: INFO/ForkPoolWorker-15] [a7a4cd5b-3ca3-488d-b1be-9705d651695e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:45:01.222302155Z [2024-02-23 04:45:01,222: INFO/ForkPoolWorker-16] [84c715ac-0bf6-495f-9d71-f7aac57796aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:45:01.227157934Z [2024-02-23 04:45:01,226: INFO/ForkPoolWorker-2] [693a4019-6546-4069-9a66-d9beeafe0c4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:45:01.237516259Z [2024-02-23 04:45:01,237: INFO/ForkPoolWorker-1] [993569d4-e415-44da-9c70-bfea75e54ccf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:45:01.573231248Z [2024-02-23 04:45:01,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:45:01.639784204Z [2024-02-23 04:45:01,636: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:45:01.660236851Z [2024-02-23 04:45:01,651: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:45:01.671827754Z [2024-02-23 04:45:01,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:45:01.907081077Z [2024-02-23 04:45:01,906: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:45:01.911513001Z [2024-02-23 04:45:01,911: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:01.948327368Z [2024-02-23 04:45:01,948: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:45:01.950284518Z [2024-02-23 04:45:01,949: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:45:01.950789727Z [2024-02-23 04:45:01,950: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:45:01.951022692Z [2024-02-23 04:45:01,950: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:45:01.951488208Z [2024-02-23 04:45:01,951: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:45:02.075764521Z [2024-02-23 04:45:02,073: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:02.771075996Z [2024-02-23 04:45:02,770: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[993569d4-e415-44da-9c70-bfea75e54ccf] succeeded in 1.5529185380000854s: None 2024-02-23T04:45:03.019758760Z [2024-02-23 04:45:03,019: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:45:03.023105280Z [2024-02-23 04:45:03,022: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:03.051864147Z [2024-02-23 04:45:03,051: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:45:03.053544798Z [2024-02-23 04:45:03,053: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:45:03.053589517Z [2024-02-23 04:45:03,053: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:45:03.053762070Z [2024-02-23 04:45:03,053: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:45:03.053806284Z [2024-02-23 04:45:03,053: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:45:03.054126258Z [2024-02-23 04:45:03,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:45:03.054180813Z [2024-02-23 04:45:03,054: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:45:03.137383732Z [2024-02-23 04:45:03,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:03.146333213Z [2024-02-23 04:45:03,145: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:45:03.149755598Z [2024-02-23 04:45:03,149: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:03.183056336Z [2024-02-23 04:45:03,182: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:45:03.185970132Z [2024-02-23 04:45:03,185: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:45:03.186800278Z [2024-02-23 04:45:03,185: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:45:03.187095476Z [2024-02-23 04:45:03,186: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:45:03.187220526Z [2024-02-23 04:45:03,187: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:45:03.187509267Z [2024-02-23 04:45:03,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:45:03.187609359Z [2024-02-23 04:45:03,187: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:45:03.252232079Z [2024-02-23 04:45:03,251: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:45:03.255646932Z [2024-02-23 04:45:03,255: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:03.288766363Z [2024-02-23 04:45:03,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:03.292671232Z [2024-02-23 04:45:03,292: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:45:03.295131895Z [2024-02-23 04:45:03,294: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:45:03.295214947Z [2024-02-23 04:45:03,295: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:45:03.295349322Z [2024-02-23 04:45:03,295: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:45:03.295385588Z [2024-02-23 04:45:03,295: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:45:03.295781725Z [2024-02-23 04:45:03,295: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:45:03.295895029Z [2024-02-23 04:45:03,295: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:45:03.424669855Z [2024-02-23 04:45:03,424: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:04.010009785Z [2024-02-23 04:45:04,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84c715ac-0bf6-495f-9d71-f7aac57796aa] succeeded in 2.7941081860008126s: None 2024-02-23T04:45:04.629911396Z [2024-02-23 04:45:04,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[340369ec-4349-4d3c-863d-ec27a8f187f5] received 2024-02-23T04:45:04.641523452Z [2024-02-23 04:45:04,641: INFO/ForkPoolWorker-16] [340369ec-4349-4d3c-863d-ec27a8f187f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:45:04.965282286Z [2024-02-23 04:45:04,964: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7a4cd5b-3ca3-488d-b1be-9705d651695e] succeeded in 3.750757794998208s: None 2024-02-23T04:45:05.052009358Z [2024-02-23 04:45:05,048: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:45:05.583086239Z [2024-02-23 04:45:05,582: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[693a4019-6546-4069-9a66-d9beeafe0c4e] succeeded in 4.362462711000262s: None 2024-02-23T04:45:06.423397686Z [2024-02-23 04:45:06,422: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:45:06.426935256Z [2024-02-23 04:45:06,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:06.454046154Z [2024-02-23 04:45:06,453: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:45:06.455487584Z [2024-02-23 04:45:06,455: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:45:06.455509510Z [2024-02-23 04:45:06,455: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:45:06.455642902Z [2024-02-23 04:45:06,455: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:45:06.455679654Z [2024-02-23 04:45:06,455: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:45:06.456011709Z [2024-02-23 04:45:06,455: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:45:06.456175466Z [2024-02-23 04:45:06,456: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:45:06.554655435Z [2024-02-23 04:45:06,554: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:07.226339238Z [2024-02-23 04:45:07,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[340369ec-4349-4d3c-863d-ec27a8f187f5] succeeded in 2.592324141998688s: None 2024-02-23T04:45:07.369637107Z [2024-02-23 04:45:07,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71602f78-c96f-435f-a61a-5484da4a37fa] received 2024-02-23T04:45:07.380414708Z [2024-02-23 04:45:07,379: INFO/ForkPoolWorker-15] [71602f78-c96f-435f-a61a-5484da4a37fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:45:07.671809874Z [2024-02-23 04:45:07,668: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:45:08.920526105Z [2024-02-23 04:45:08,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:45:08.923771413Z [2024-02-23 04:45:08,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:08.942632467Z [2024-02-23 04:45:08,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:45:08.943686043Z [2024-02-23 04:45:08,943: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:45:08.943704311Z [2024-02-23 04:45:08,943: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:45:08.943812232Z [2024-02-23 04:45:08,943: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:45:08.943840507Z [2024-02-23 04:45:08,943: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:45:08.944056169Z [2024-02-23 04:45:08,943: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:45:08.944087735Z [2024-02-23 04:45:08,944: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:45:09.027581892Z [2024-02-23 04:45:09,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:09.578784489Z [2024-02-23 04:45:09,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71602f78-c96f-435f-a61a-5484da4a37fa] succeeded in 2.2070473419989867s: None 2024-02-23T04:45:09.703620154Z [2024-02-23 04:45:09,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8826e97-11e9-474f-af23-6bc6366ab92c] received 2024-02-23T04:45:09.717078272Z [2024-02-23 04:45:09,715: INFO/ForkPoolWorker-15] [e8826e97-11e9-474f-af23-6bc6366ab92c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:45:10.010533188Z [2024-02-23 04:45:10,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:45:11.112630221Z [2024-02-23 04:45:11,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:45:11.115939255Z [2024-02-23 04:45:11,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:45:11.132978254Z [2024-02-23 04:45:11,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:45:11.134742915Z [2024-02-23 04:45:11,134: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:45:11.134886911Z [2024-02-23 04:45:11,134: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:45:11.135062197Z [2024-02-23 04:45:11,134: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:45:11.135158276Z [2024-02-23 04:45:11,135: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:45:11.135415847Z [2024-02-23 04:45:11,135: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:45:11.135519040Z [2024-02-23 04:45:11,135: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:45:11.237669774Z [2024-02-23 04:45:11,237: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:45:11.820285753Z [2024-02-23 04:45:11,819: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8826e97-11e9-474f-af23-6bc6366ab92c] succeeded in 2.1145651769984397s: None 2024-02-23T04:46:00.316936796Z [2024-02-23 04:46:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1bf2786-7fc2-4e79-8f6f-909a2ada352f] received 2024-02-23T04:46:00.318512431Z [2024-02-23 04:46:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23c8640d-2aac-4b83-a7a5-37d1c9a8d5c4] received 2024-02-23T04:46:00.325319755Z [2024-02-23 04:46:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc3a6128-b455-4aad-8a91-b069ca171656] received 2024-02-23T04:46:00.325672411Z [2024-02-23 04:46:00,325: INFO/ForkPoolWorker-15] [c1bf2786-7fc2-4e79-8f6f-909a2ada352f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:46:00.328275880Z [2024-02-23 04:46:00,328: INFO/ForkPoolWorker-16] [23c8640d-2aac-4b83-a7a5-37d1c9a8d5c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:46:00.341641715Z [2024-02-23 04:46:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0145fbd8-4bb6-4d03-b2e9-5cf7ec3bf42c] received 2024-02-23T04:46:00.347313859Z [2024-02-23 04:46:00,347: INFO/ForkPoolWorker-2] [0145fbd8-4bb6-4d03-b2e9-5cf7ec3bf42c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:46:00.350564386Z [2024-02-23 04:46:00,350: INFO/ForkPoolWorker-1] [cc3a6128-b455-4aad-8a91-b069ca171656] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:46:00.637220390Z [2024-02-23 04:46:00,634: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:46:00.654457496Z [2024-02-23 04:46:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:46:00.665572245Z [2024-02-23 04:46:00,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:46:00.686004207Z [2024-02-23 04:46:00,682: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:46:00.813911868Z [2024-02-23 04:46:00,813: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:46:00.817903370Z [2024-02-23 04:46:00,817: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:46:00.842898677Z [2024-02-23 04:46:00,842: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:46:00.845074318Z [2024-02-23 04:46:00,844: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:46:00.845106418Z [2024-02-23 04:46:00,844: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:46:00.845111184Z [2024-02-23 04:46:00,844: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:46:00.845139467Z [2024-02-23 04:46:00,845: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:46:00.992303199Z [2024-02-23 04:46:00,992: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:46:01.032854852Z [2024-02-23 04:46:01,032: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:46:01.545013537Z [2024-02-23 04:46:01,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1bf2786-7fc2-4e79-8f6f-909a2ada352f] succeeded in 1.2249461780011188s: None 2024-02-23T04:46:01.705076499Z [2024-02-23 04:46:01,704: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0145fbd8-4bb6-4d03-b2e9-5cf7ec3bf42c] succeeded in 1.362088144000154s: None 2024-02-23T04:46:01.926028750Z [2024-02-23 04:46:01,925: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:46:01.929703612Z [2024-02-23 04:46:01,929: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:46:01.950158327Z [2024-02-23 04:46:01,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:46:01.951532341Z [2024-02-23 04:46:01,951: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:46:01.951762299Z [2024-02-23 04:46:01,951: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:46:01.951968397Z [2024-02-23 04:46:01,951: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:46:01.952078476Z [2024-02-23 04:46:01,951: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:46:01.952358953Z [2024-02-23 04:46:01,952: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:46:01.952517765Z [2024-02-23 04:46:01,952: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:46:01.986665729Z [2024-02-23 04:46:01,986: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:46:01.989888256Z [2024-02-23 04:46:01,989: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:46:02.013497903Z [2024-02-23 04:46:02,013: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:46:02.014983876Z [2024-02-23 04:46:02,014: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:46:02.015047712Z [2024-02-23 04:46:02,014: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:46:02.015258068Z [2024-02-23 04:46:02,014: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:46:02.015375092Z [2024-02-23 04:46:02,015: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:46:02.015620541Z [2024-02-23 04:46:02,015: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:46:02.015805541Z [2024-02-23 04:46:02,015: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:46:02.038864035Z [2024-02-23 04:46:02,038: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:46:02.091007510Z [2024-02-23 04:46:02,090: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:46:03.641920354Z [2024-02-23 04:46:03,641: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc3a6128-b455-4aad-8a91-b069ca171656] succeeded in 3.3014560169976903s: None 2024-02-23T04:46:04.079517263Z [2024-02-23 04:46:04,078: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23c8640d-2aac-4b83-a7a5-37d1c9a8d5c4] succeeded in 3.7582994990007137s: None 2024-02-23T04:47:01.056429828Z [2024-02-23 04:47:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dda2c63a-3349-4e34-893c-bf59bc7f9bd6] received 2024-02-23T04:47:01.058059335Z [2024-02-23 04:47:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4381b0d3-a7ab-49e5-a75c-886233ba8adc] received 2024-02-23T04:47:01.065570986Z [2024-02-23 04:47:01,065: INFO/ForkPoolWorker-16] [4381b0d3-a7ab-49e5-a75c-886233ba8adc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:47:01.069446095Z [2024-02-23 04:47:01,069: INFO/ForkPoolWorker-15] [dda2c63a-3349-4e34-893c-bf59bc7f9bd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:47:01.078381568Z [2024-02-23 04:47:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fa596d3-77b5-4ce4-ab6f-8fefbafa0595] received 2024-02-23T04:47:01.089158136Z [2024-02-23 04:47:01,088: INFO/ForkPoolWorker-1] [0fa596d3-77b5-4ce4-ab6f-8fefbafa0595] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:47:01.381498951Z [2024-02-23 04:47:01,378: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:47:01.384121391Z [2024-02-23 04:47:01,372: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:47:01.402414525Z [2024-02-23 04:47:01,398: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:47:01.572156910Z [2024-02-23 04:47:01,571: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:47:01.576956870Z [2024-02-23 04:47:01,576: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:47:01.594474580Z [2024-02-23 04:47:01,594: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:47:01.595682224Z [2024-02-23 04:47:01,595: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:47:01.595817832Z [2024-02-23 04:47:01,595: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:47:01.595901253Z [2024-02-23 04:47:01,595: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:47:01.596147095Z [2024-02-23 04:47:01,596: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:47:01.691324755Z [2024-02-23 04:47:01,691: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:47:02.243463410Z [2024-02-23 04:47:02,243: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0fa596d3-77b5-4ce4-ab6f-8fefbafa0595] succeeded in 1.1627866279995942s: None 2024-02-23T04:47:02.568576644Z [2024-02-23 04:47:02,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:47:02.568712779Z [2024-02-23 04:47:02,568: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:47:02.572118677Z [2024-02-23 04:47:02,571: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:47:02.572198281Z [2024-02-23 04:47:02,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:47:02.591536174Z [2024-02-23 04:47:02,591: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:47:02.593479520Z [2024-02-23 04:47:02,593: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:47:02.593501164Z [2024-02-23 04:47:02,593: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:47:02.593706248Z [2024-02-23 04:47:02,593: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:47:02.593786661Z [2024-02-23 04:47:02,593: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:47:02.594110868Z [2024-02-23 04:47:02,593: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:47:02.594130750Z [2024-02-23 04:47:02,594: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:47:02.595933684Z [2024-02-23 04:47:02,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:47:02.597387939Z [2024-02-23 04:47:02,597: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:47:02.597551016Z [2024-02-23 04:47:02,597: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:47:02.597772732Z [2024-02-23 04:47:02,597: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:47:02.597902521Z [2024-02-23 04:47:02,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:47:02.598577066Z [2024-02-23 04:47:02,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:47:02.598662356Z [2024-02-23 04:47:02,598: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:47:02.703975496Z [2024-02-23 04:47:02,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:47:02.708423727Z [2024-02-23 04:47:02,708: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:47:04.759634635Z [2024-02-23 04:47:04,757: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dda2c63a-3349-4e34-893c-bf59bc7f9bd6] succeeded in 3.6980178199992224s: None 2024-02-23T04:47:06.383936148Z [2024-02-23 04:47:06,383: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4381b0d3-a7ab-49e5-a75c-886233ba8adc] succeeded in 5.324390604997461s: None 2024-02-23T04:48:01.031942821Z [2024-02-23 04:48:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e8ca37c-e352-45b0-8525-a8b95cfd04db] received 2024-02-23T04:48:01.035338337Z [2024-02-23 04:48:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5f632ea-ec59-4600-a50e-39711a6695a9] received 2024-02-23T04:48:01.040155646Z [2024-02-23 04:48:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3c4eb84-c6e1-45aa-a5ec-59a60bb50488] received 2024-02-23T04:48:01.044289301Z [2024-02-23 04:48:01,043: INFO/ForkPoolWorker-16] [a5f632ea-ec59-4600-a50e-39711a6695a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:48:01.047214474Z [2024-02-23 04:48:01,046: INFO/ForkPoolWorker-15] [3e8ca37c-e352-45b0-8525-a8b95cfd04db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:48:01.049435844Z [2024-02-23 04:48:01,049: INFO/ForkPoolWorker-1] [d3c4eb84-c6e1-45aa-a5ec-59a60bb50488] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:48:01.061384074Z [2024-02-23 04:48:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e61377e4-a436-4290-ac30-30bdc3a47fdb] received 2024-02-23T04:48:01.075512175Z [2024-02-23 04:48:01,075: INFO/ForkPoolWorker-2] [e61377e4-a436-4290-ac30-30bdc3a47fdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:48:01.353152694Z [2024-02-23 04:48:01,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:48:01.382200066Z [2024-02-23 04:48:01,379: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:48:01.389513253Z [2024-02-23 04:48:01,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:48:01.491808942Z [2024-02-23 04:48:01,486: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:48:01.655418764Z [2024-02-23 04:48:01,655: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:48:01.738987399Z [2024-02-23 04:48:01,735: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:48:01.749258197Z [2024-02-23 04:48:01,748: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:48:01.799627690Z [2024-02-23 04:48:01,799: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:48:01.800922357Z [2024-02-23 04:48:01,800: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:48:01.800992844Z [2024-02-23 04:48:01,800: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:48:01.801017816Z [2024-02-23 04:48:01,800: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:48:01.801223986Z [2024-02-23 04:48:01,801: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:48:01.917199989Z [2024-02-23 04:48:01,916: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:48:02.411936692Z [2024-02-23 04:48:02,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e8ca37c-e352-45b0-8525-a8b95cfd04db] succeeded in 1.3758180680015357s: None 2024-02-23T04:48:02.648246515Z [2024-02-23 04:48:02,647: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:48:02.651540529Z [2024-02-23 04:48:02,651: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:48:02.692595308Z [2024-02-23 04:48:02,692: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e61377e4-a436-4290-ac30-30bdc3a47fdb] succeeded in 1.6237943909982278s: None 2024-02-23T04:48:02.693866125Z [2024-02-23 04:48:02,693: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:48:02.696341517Z [2024-02-23 04:48:02,695: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:48:02.696514033Z [2024-02-23 04:48:02,696: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:48:02.696861576Z [2024-02-23 04:48:02,696: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:48:02.697026064Z [2024-02-23 04:48:02,696: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:48:02.697615802Z [2024-02-23 04:48:02,697: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:48:02.697816993Z [2024-02-23 04:48:02,697: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:48:02.792866035Z [2024-02-23 04:48:02,792: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:48:02.906251336Z [2024-02-23 04:48:02,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:48:02.909458799Z [2024-02-23 04:48:02,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:48:02.934802800Z [2024-02-23 04:48:02,934: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:48:02.936725521Z [2024-02-23 04:48:02,936: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:48:02.936988760Z [2024-02-23 04:48:02,936: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:48:02.937210939Z [2024-02-23 04:48:02,936: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:48:02.937376928Z [2024-02-23 04:48:02,937: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:48:02.937780246Z [2024-02-23 04:48:02,937: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:48:02.937981729Z [2024-02-23 04:48:02,937: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:48:03.035654879Z [2024-02-23 04:48:03,035: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:48:04.435028809Z [2024-02-23 04:48:04,434: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3c4eb84-c6e1-45aa-a5ec-59a60bb50488] succeeded in 3.3933086559991352s: None 2024-02-23T04:48:05.416435129Z [2024-02-23 04:48:05,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a5f632ea-ec59-4600-a50e-39711a6695a9] succeeded in 4.3794873879996885s: None 2024-02-23T04:48:28.268342469Z [2024-02-23 04:48:28,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e69a8ac8-6759-4ff7-b7c5-d7142c00b50d] received 2024-02-23T04:48:28.278156429Z [2024-02-23 04:48:28,277: INFO/ForkPoolWorker-15] [e69a8ac8-6759-4ff7-b7c5-d7142c00b50d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223044827_111627', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:48:28.565705106Z [2024-02-23 04:48:28,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:48:28.835491529Z [2024-02-23 04:48:28,835: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:48:29.599722345Z [2024-02-23 04:48:29,598: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e69a8ac8-6759-4ff7-b7c5-d7142c00b50d] succeeded in 1.3271529000012379s: None 2024-02-23T04:49:01.111233818Z [2024-02-23 04:49:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3255337c-2d9a-4afb-8633-4b26cda56a0b] received 2024-02-23T04:49:01.113830914Z [2024-02-23 04:49:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4efa6956-6e88-4e4e-b0fb-858569081d30] received 2024-02-23T04:49:01.120965001Z [2024-02-23 04:49:01,120: INFO/ForkPoolWorker-15] [3255337c-2d9a-4afb-8633-4b26cda56a0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:49:01.123304473Z [2024-02-23 04:49:01,122: INFO/ForkPoolWorker-16] [4efa6956-6e88-4e4e-b0fb-858569081d30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:49:01.124013343Z [2024-02-23 04:49:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df0f2f2e-cb8c-4442-b820-93592c1c00c5] received 2024-02-23T04:49:01.141416307Z [2024-02-23 04:49:01,141: INFO/ForkPoolWorker-1] [df0f2f2e-cb8c-4442-b820-93592c1c00c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:49:01.437936195Z [2024-02-23 04:49:01,435: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:49:01.453163987Z [2024-02-23 04:49:01,450: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:49:01.461614462Z [2024-02-23 04:49:01,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:49:01.612962359Z [2024-02-23 04:49:01,612: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:49:01.617055161Z [2024-02-23 04:49:01,616: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:49:01.647961237Z [2024-02-23 04:49:01,647: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:49:01.649165935Z [2024-02-23 04:49:01,648: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:49:01.649381708Z [2024-02-23 04:49:01,649: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:49:01.649494154Z [2024-02-23 04:49:01,649: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:49:01.650059685Z [2024-02-23 04:49:01,649: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:49:01.767953960Z [2024-02-23 04:49:01,767: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:49:02.387619224Z [2024-02-23 04:49:02,387: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df0f2f2e-cb8c-4442-b820-93592c1c00c5] succeeded in 1.2613689220015658s: None 2024-02-23T04:49:02.588092344Z [2024-02-23 04:49:02,587: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:49:02.591570364Z [2024-02-23 04:49:02,590: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:49:02.612471475Z [2024-02-23 04:49:02,612: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:49:02.613683450Z [2024-02-23 04:49:02,613: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:49:02.613723028Z [2024-02-23 04:49:02,613: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:49:02.613914101Z [2024-02-23 04:49:02,613: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:49:02.614057441Z [2024-02-23 04:49:02,613: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:49:02.614424407Z [2024-02-23 04:49:02,614: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:49:02.614435931Z [2024-02-23 04:49:02,614: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:49:02.706452159Z [2024-02-23 04:49:02,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:49:02.753521269Z [2024-02-23 04:49:02,753: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:49:02.757029442Z [2024-02-23 04:49:02,756: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:49:02.776518484Z [2024-02-23 04:49:02,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:49:02.777892507Z [2024-02-23 04:49:02,777: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:49:02.777910358Z [2024-02-23 04:49:02,777: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:49:02.778050920Z [2024-02-23 04:49:02,777: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:49:02.778106917Z [2024-02-23 04:49:02,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:49:02.778429192Z [2024-02-23 04:49:02,778: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:49:02.778466529Z [2024-02-23 04:49:02,778: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:49:02.863100484Z [2024-02-23 04:49:02,862: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:49:06.122594738Z [2024-02-23 04:49:06,121: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3255337c-2d9a-4afb-8633-4b26cda56a0b] succeeded in 5.007030038999801s: None 2024-02-23T04:49:06.374195575Z [2024-02-23 04:49:06,373: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4efa6956-6e88-4e4e-b0fb-858569081d30] succeeded in 5.257472458000848s: None 2024-02-23T04:50:00.929575357Z [2024-02-23 04:50:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c9baeba-8e0a-4db1-bb1f-a3f8d467c7b0] received 2024-02-23T04:50:00.932912265Z [2024-02-23 04:50:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bc5ab73-a697-4061-b5da-e199e8b6bd8b] received 2024-02-23T04:50:00.940770458Z [2024-02-23 04:50:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7d04b4d-4013-4e58-a3b6-fc82456852a3] received 2024-02-23T04:50:00.941587248Z [2024-02-23 04:50:00,941: INFO/ForkPoolWorker-15] [4c9baeba-8e0a-4db1-bb1f-a3f8d467c7b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:50:00.943743390Z [2024-02-23 04:50:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c704a376-8520-474a-98ed-62f9b57e19ab] received 2024-02-23T04:50:00.945406978Z [2024-02-23 04:50:00,945: INFO/ForkPoolWorker-16] [5bc5ab73-a697-4061-b5da-e199e8b6bd8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:50:00.951840224Z [2024-02-23 04:50:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fbde0a4-9014-4157-b8bf-9f5d9815a833] received 2024-02-23T04:50:00.952983141Z [2024-02-23 04:50:00,952: INFO/ForkPoolWorker-2] [c704a376-8520-474a-98ed-62f9b57e19ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:50:00.962785289Z [2024-02-23 04:50:00,962: INFO/ForkPoolWorker-1] [e7d04b4d-4013-4e58-a3b6-fc82456852a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:50:00.968061657Z [2024-02-23 04:50:00,967: INFO/ForkPoolWorker-3] [6fbde0a4-9014-4157-b8bf-9f5d9815a833] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:50:01.406300205Z [2024-02-23 04:50:01,403: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:50:01.513721814Z [2024-02-23 04:50:01,510: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:50:01.526752049Z [2024-02-23 04:50:01,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:50:01.698522637Z [2024-02-23 04:50:01,694: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:50:01.768175772Z [2024-02-23 04:50:01,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:50:01.778557802Z [2024-02-23 04:50:01,778: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:50:01.797639313Z [2024-02-23 04:50:01,797: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:01.875266284Z [2024-02-23 04:50:01,875: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:01.903468082Z [2024-02-23 04:50:01,903: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:50:01.911433852Z [2024-02-23 04:50:01,911: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:50:01.911644727Z [2024-02-23 04:50:01,911: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:50:01.911708790Z [2024-02-23 04:50:01,911: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:50:01.912054310Z [2024-02-23 04:50:01,911: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:50:02.241662892Z [2024-02-23 04:50:02,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:02.879907362Z [2024-02-23 04:50:02,879: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5bc5ab73-a697-4061-b5da-e199e8b6bd8b] succeeded in 1.944539447002171s: None 2024-02-23T04:50:03.283889658Z [2024-02-23 04:50:03,283: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7d04b4d-4013-4e58-a3b6-fc82456852a3] succeeded in 2.3406108660019527s: None 2024-02-23T04:50:03.388456407Z [2024-02-23 04:50:03,388: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:50:03.391772619Z [2024-02-23 04:50:03,391: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:03.426785221Z [2024-02-23 04:50:03,426: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:50:03.429801952Z [2024-02-23 04:50:03,429: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:50:03.429818618Z [2024-02-23 04:50:03,429: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:50:03.429979997Z [2024-02-23 04:50:03,429: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:50:03.430017508Z [2024-02-23 04:50:03,429: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:50:03.430307643Z [2024-02-23 04:50:03,430: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:50:03.430344775Z [2024-02-23 04:50:03,430: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:50:03.528312678Z [2024-02-23 04:50:03,527: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:03.539082109Z [2024-02-23 04:50:03,538: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:50:03.542476500Z [2024-02-23 04:50:03,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:03.580034466Z [2024-02-23 04:50:03,579: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:50:03.588614604Z [2024-02-23 04:50:03,588: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:50:03.588967160Z [2024-02-23 04:50:03,588: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:50:03.589300085Z [2024-02-23 04:50:03,588: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:50:03.589572078Z [2024-02-23 04:50:03,589: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:50:03.590068081Z [2024-02-23 04:50:03,589: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:50:03.591062055Z [2024-02-23 04:50:03,589: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:50:03.696057108Z [2024-02-23 04:50:03,695: INFO/ForkPoolWorker-3] Getting VIM list 2024-02-23T04:50:03.699662830Z [2024-02-23 04:50:03,699: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:03.713599030Z [2024-02-23 04:50:03,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:03.753856817Z [2024-02-23 04:50:03,753: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-02-23T04:50:03.755243241Z [2024-02-23 04:50:03,755: INFO/ForkPoolWorker-3] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:50:03.755396203Z [2024-02-23 04:50:03,755: INFO/ForkPoolWorker-3] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:50:03.756819402Z [2024-02-23 04:50:03,756: INFO/ForkPoolWorker-3] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:50:03.756906233Z [2024-02-23 04:50:03,756: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-02-23T04:50:03.757172722Z [2024-02-23 04:50:03,757: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:50:03.757428913Z [2024-02-23 04:50:03,757: INFO/ForkPoolWorker-3] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:50:03.876006931Z [2024-02-23 04:50:03,875: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:04.408281101Z [2024-02-23 04:50:04,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03cf200c-7a20-40f6-8072-58b03e0849a7] received 2024-02-23T04:50:04.422722428Z [2024-02-23 04:50:04,422: INFO/ForkPoolWorker-16] [03cf200c-7a20-40f6-8072-58b03e0849a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:50:04.426565434Z [2024-02-23 04:50:04,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c9baeba-8e0a-4db1-bb1f-a3f8d467c7b0] succeeded in 3.492426008997427s: None 2024-02-23T04:50:04.743575288Z [2024-02-23 04:50:04,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:50:05.672022336Z [2024-02-23 04:50:05,671: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c704a376-8520-474a-98ed-62f9b57e19ab] succeeded in 4.7249893129992415s: None 2024-02-23T04:50:05.879654727Z [2024-02-23 04:50:05,879: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:50:05.883404001Z [2024-02-23 04:50:05,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:05.904983953Z [2024-02-23 04:50:05,904: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:50:05.906388136Z [2024-02-23 04:50:05,906: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:50:05.906447830Z [2024-02-23 04:50:05,906: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:50:05.906550383Z [2024-02-23 04:50:05,906: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:50:05.906605219Z [2024-02-23 04:50:05,906: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:50:05.906818361Z [2024-02-23 04:50:05,906: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:50:05.906934742Z [2024-02-23 04:50:05,906: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:50:05.978948367Z [2024-02-23 04:50:05,978: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6fbde0a4-9014-4157-b8bf-9f5d9815a833] succeeded in 5.024749882999458s: None 2024-02-23T04:50:06.001557177Z [2024-02-23 04:50:06,000: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:06.773055928Z [2024-02-23 04:50:06,772: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03cf200c-7a20-40f6-8072-58b03e0849a7] succeeded in 2.362745899001311s: None 2024-02-23T04:50:07.045783312Z [2024-02-23 04:50:07,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e80de20f-e1d8-4e6e-93d9-c30cf883ee7f] received 2024-02-23T04:50:07.057174102Z [2024-02-23 04:50:07,056: INFO/ForkPoolWorker-15] [e80de20f-e1d8-4e6e-93d9-c30cf883ee7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:50:07.357965841Z [2024-02-23 04:50:07,355: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:50:08.490764481Z [2024-02-23 04:50:08,488: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:50:08.492453924Z [2024-02-23 04:50:08,491: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:08.515968223Z [2024-02-23 04:50:08,515: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:50:08.519352461Z [2024-02-23 04:50:08,519: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:50:08.519588753Z [2024-02-23 04:50:08,519: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:50:08.519907447Z [2024-02-23 04:50:08,519: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:50:08.520123300Z [2024-02-23 04:50:08,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:50:08.520780808Z [2024-02-23 04:50:08,520: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:50:08.520995979Z [2024-02-23 04:50:08,520: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:50:08.617949452Z [2024-02-23 04:50:08,617: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:09.186555270Z [2024-02-23 04:50:09,185: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e80de20f-e1d8-4e6e-93d9-c30cf883ee7f] succeeded in 2.138887616998545s: None 2024-02-23T04:50:09.388179996Z [2024-02-23 04:50:09,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa19314b-56f4-460e-a88f-0ee5accd8dec] received 2024-02-23T04:50:09.394568452Z [2024-02-23 04:50:09,394: INFO/ForkPoolWorker-15] [aa19314b-56f4-460e-a88f-0ee5accd8dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:50:09.694960484Z [2024-02-23 04:50:09,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:50:10.870042198Z [2024-02-23 04:50:10,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:50:10.873100264Z [2024-02-23 04:50:10,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:50:10.893610869Z [2024-02-23 04:50:10,893: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:50:10.894991922Z [2024-02-23 04:50:10,894: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:50:10.895148889Z [2024-02-23 04:50:10,894: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:50:10.895311856Z [2024-02-23 04:50:10,894: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:50:10.895388123Z [2024-02-23 04:50:10,895: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:50:10.895583854Z [2024-02-23 04:50:10,895: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:50:10.895688168Z [2024-02-23 04:50:10,895: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:50:10.987164152Z [2024-02-23 04:50:10,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:50:11.529880885Z [2024-02-23 04:50:11,529: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa19314b-56f4-460e-a88f-0ee5accd8dec] succeeded in 2.1398322969980654s: None 2024-02-23T04:51:00.841668393Z [2024-02-23 04:51:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f8a7d20-ab94-45a2-9a7d-16aa148c306c] received 2024-02-23T04:51:00.846601040Z [2024-02-23 04:51:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[547d8134-2d77-49c0-abda-30fd53f3334a] received 2024-02-23T04:51:00.851177640Z [2024-02-23 04:51:00,850: INFO/ForkPoolWorker-15] [9f8a7d20-ab94-45a2-9a7d-16aa148c306c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:51:00.852688615Z [2024-02-23 04:51:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c113ac-253f-4121-88e1-d1eb61d10064] received 2024-02-23T04:51:00.858235633Z [2024-02-23 04:51:00,857: INFO/ForkPoolWorker-16] [547d8134-2d77-49c0-abda-30fd53f3334a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:51:00.866277420Z [2024-02-23 04:51:00,865: INFO/ForkPoolWorker-1] [97c113ac-253f-4121-88e1-d1eb61d10064] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:51:01.191913923Z [2024-02-23 04:51:01,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:51:01.261087542Z [2024-02-23 04:51:01,257: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:51:01.271209326Z [2024-02-23 04:51:01,268: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:51:01.503617917Z [2024-02-23 04:51:01,503: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:51:01.508961226Z [2024-02-23 04:51:01,508: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:51:01.536052295Z [2024-02-23 04:51:01,535: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:51:01.539876767Z [2024-02-23 04:51:01,539: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:51:01.540848191Z [2024-02-23 04:51:01,540: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:51:01.541202955Z [2024-02-23 04:51:01,540: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:51:01.542155165Z [2024-02-23 04:51:01,541: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:51:01.664537123Z [2024-02-23 04:51:01,664: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:51:02.312387067Z [2024-02-23 04:51:02,311: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97c113ac-253f-4121-88e1-d1eb61d10064] succeeded in 1.4555127669991634s: None 2024-02-23T04:51:02.445568269Z [2024-02-23 04:51:02,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:51:02.449005687Z [2024-02-23 04:51:02,448: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:51:02.470916562Z [2024-02-23 04:51:02,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:51:02.472835629Z [2024-02-23 04:51:02,472: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:51:02.472857442Z [2024-02-23 04:51:02,472: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:51:02.472980419Z [2024-02-23 04:51:02,472: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:51:02.473010626Z [2024-02-23 04:51:02,472: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:51:02.473570139Z [2024-02-23 04:51:02,473: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:51:02.473688494Z [2024-02-23 04:51:02,473: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:51:02.573826546Z [2024-02-23 04:51:02,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:51:02.589943844Z [2024-02-23 04:51:02,589: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:51:02.595811404Z [2024-02-23 04:51:02,595: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:51:02.618543224Z [2024-02-23 04:51:02,618: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:51:02.619990518Z [2024-02-23 04:51:02,619: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:51:02.620022261Z [2024-02-23 04:51:02,619: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:51:02.620238747Z [2024-02-23 04:51:02,619: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:51:02.620384512Z [2024-02-23 04:51:02,620: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:51:02.620632834Z [2024-02-23 04:51:02,620: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:51:02.620792637Z [2024-02-23 04:51:02,620: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:51:02.715846842Z [2024-02-23 04:51:02,715: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:51:04.501490296Z [2024-02-23 04:51:04,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f8a7d20-ab94-45a2-9a7d-16aa148c306c] succeeded in 3.656922194000799s: None 2024-02-23T04:51:05.145335837Z [2024-02-23 04:51:05,144: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[547d8134-2d77-49c0-abda-30fd53f3334a] succeeded in 4.297059796001122s: None 2024-02-23T04:52:00.326245902Z [2024-02-23 04:52:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c8bff1f-df13-4a97-a33b-69bec6b0153d] received 2024-02-23T04:52:00.332572475Z [2024-02-23 04:52:00,332: INFO/ForkPoolWorker-15] [7c8bff1f-df13-4a97-a33b-69bec6b0153d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:52:00.333763255Z [2024-02-23 04:52:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f28ead67-949d-4874-9166-37c9df2dc91a] received 2024-02-23T04:52:00.336632145Z [2024-02-23 04:52:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[777ef02a-d470-4368-be3b-ad0a5d893dcd] received 2024-02-23T04:52:00.344149517Z [2024-02-23 04:52:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a215fcf-2692-4356-887c-18a890c592fb] received 2024-02-23T04:52:00.346635621Z [2024-02-23 04:52:00,346: INFO/ForkPoolWorker-1] [777ef02a-d470-4368-be3b-ad0a5d893dcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:52:00.351926315Z [2024-02-23 04:52:00,351: INFO/ForkPoolWorker-16] [f28ead67-949d-4874-9166-37c9df2dc91a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:52:00.369583983Z [2024-02-23 04:52:00,369: INFO/ForkPoolWorker-2] [9a215fcf-2692-4356-887c-18a890c592fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:52:00.679203320Z [2024-02-23 04:52:00,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:52:00.701048527Z [2024-02-23 04:52:00,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:52:00.708207235Z [2024-02-23 04:52:00,704: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:52:00.803741543Z [2024-02-23 04:52:00,800: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:52:00.896073588Z [2024-02-23 04:52:00,895: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:52:00.901602550Z [2024-02-23 04:52:00,901: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:52:00.914395446Z [2024-02-23 04:52:00,914: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:52:00.940672403Z [2024-02-23 04:52:00,940: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:52:00.941751666Z [2024-02-23 04:52:00,941: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:52:00.942175425Z [2024-02-23 04:52:00,941: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:52:00.942341110Z [2024-02-23 04:52:00,942: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:52:00.942719259Z [2024-02-23 04:52:00,942: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:52:01.099058892Z [2024-02-23 04:52:01,098: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:52:01.452178836Z [2024-02-23 04:52:01,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c8bff1f-df13-4a97-a33b-69bec6b0153d] succeeded in 1.1241024970004219s: None 2024-02-23T04:52:01.733915882Z [2024-02-23 04:52:01,733: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a215fcf-2692-4356-887c-18a890c592fb] succeeded in 1.3869079950018204s: None 2024-02-23T04:52:01.981412546Z [2024-02-23 04:52:01,981: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:52:01.995814695Z [2024-02-23 04:52:01,986: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:52:02.015961870Z [2024-02-23 04:52:02,015: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:52:02.017481877Z [2024-02-23 04:52:02,017: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:52:02.017502631Z [2024-02-23 04:52:02,017: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:52:02.017508777Z [2024-02-23 04:52:02,017: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:52:02.017633616Z [2024-02-23 04:52:02,017: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:52:02.018616153Z [2024-02-23 04:52:02,018: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:52:02.018805264Z [2024-02-23 04:52:02,018: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:52:02.124188631Z [2024-02-23 04:52:02,123: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:52:02.180891829Z [2024-02-23 04:52:02,180: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:52:02.184167717Z [2024-02-23 04:52:02,183: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:52:02.209088945Z [2024-02-23 04:52:02,208: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:52:02.210799321Z [2024-02-23 04:52:02,210: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:52:02.210811763Z [2024-02-23 04:52:02,210: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:52:02.211036226Z [2024-02-23 04:52:02,210: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:52:02.211105236Z [2024-02-23 04:52:02,211: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:52:02.211487709Z [2024-02-23 04:52:02,211: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:52:02.211621212Z [2024-02-23 04:52:02,211: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:52:02.331134715Z [2024-02-23 04:52:02,330: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:52:04.038712430Z [2024-02-23 04:52:04,038: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f28ead67-949d-4874-9166-37c9df2dc91a] succeeded in 3.700782502997754s: None 2024-02-23T04:52:04.315014142Z [2024-02-23 04:52:04,314: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[777ef02a-d470-4368-be3b-ad0a5d893dcd] succeeded in 3.9767440960022213s: None 2024-02-23T04:52:28.556666612Z [2024-02-23 04:52:28,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4d1f5f7-e961-408a-b681-24d050ef5198] received 2024-02-23T04:52:28.564209740Z [2024-02-23 04:52:28,563: INFO/ForkPoolWorker-15] [f4d1f5f7-e961-408a-b681-24d050ef5198] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240223045227_405646', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-23T04:52:28.838791302Z [2024-02-23 04:52:28,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-02-23T04:52:29.166903863Z [2024-02-23 04:52:29,166: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:52:29.866447221Z [2024-02-23 04:52:29,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4d1f5f7-e961-408a-b681-24d050ef5198] succeeded in 1.306580518001283s: None 2024-02-23T04:53:00.214916732Z [2024-02-23 04:53:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5823be5f-b008-48a7-9c1b-b9f38b79fa63] received 2024-02-23T04:53:00.216599317Z [2024-02-23 04:53:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33baf454-0254-4ce0-87f2-9dcc6230a85f] received 2024-02-23T04:53:00.217806695Z [2024-02-23 04:53:00,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a39fcb2-16f1-440e-8332-983a8a2fedb4] received 2024-02-23T04:53:00.227051159Z [2024-02-23 04:53:00,225: INFO/ForkPoolWorker-1] [6a39fcb2-16f1-440e-8332-983a8a2fedb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:53:00.229048532Z [2024-02-23 04:53:00,228: INFO/ForkPoolWorker-15] [5823be5f-b008-48a7-9c1b-b9f38b79fa63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:53:00.229369323Z [2024-02-23 04:53:00,229: INFO/ForkPoolWorker-16] [33baf454-0254-4ce0-87f2-9dcc6230a85f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:53:00.509337846Z [2024-02-23 04:53:00,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:53:00.563398873Z [2024-02-23 04:53:00,559: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:53:00.594322726Z [2024-02-23 04:53:00,590: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:53:00.683373541Z [2024-02-23 04:53:00,682: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:53:00.687812430Z [2024-02-23 04:53:00,687: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:53:00.717404325Z [2024-02-23 04:53:00,717: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:53:00.719260740Z [2024-02-23 04:53:00,718: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:53:00.719527334Z [2024-02-23 04:53:00,719: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:53:00.719637544Z [2024-02-23 04:53:00,719: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:53:00.720226064Z [2024-02-23 04:53:00,720: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:53:00.815707974Z [2024-02-23 04:53:00,815: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:53:01.426676990Z [2024-02-23 04:53:01,425: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33baf454-0254-4ce0-87f2-9dcc6230a85f] succeeded in 1.2064084989979165s: None 2024-02-23T04:53:01.735045923Z [2024-02-23 04:53:01,734: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:53:01.738483800Z [2024-02-23 04:53:01,738: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:53:01.771657311Z [2024-02-23 04:53:01,771: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:53:01.773879181Z [2024-02-23 04:53:01,773: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:53:01.774102446Z [2024-02-23 04:53:01,773: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:53:01.774375384Z [2024-02-23 04:53:01,774: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:53:01.774537822Z [2024-02-23 04:53:01,774: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:53:01.775037609Z [2024-02-23 04:53:01,774: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:53:01.775184821Z [2024-02-23 04:53:01,775: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:53:01.883818226Z [2024-02-23 04:53:01,883: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:53:01.887021457Z [2024-02-23 04:53:01,886: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:53:01.897406295Z [2024-02-23 04:53:01,896: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:53:01.908301678Z [2024-02-23 04:53:01,908: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:53:01.909698594Z [2024-02-23 04:53:01,909: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:53:01.909763727Z [2024-02-23 04:53:01,909: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:53:01.909924079Z [2024-02-23 04:53:01,909: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:53:01.909992234Z [2024-02-23 04:53:01,909: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:53:01.910570029Z [2024-02-23 04:53:01,910: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:53:01.910586848Z [2024-02-23 04:53:01,910: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:53:02.021946642Z [2024-02-23 04:53:02,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:53:03.590776287Z [2024-02-23 04:53:03,589: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a39fcb2-16f1-440e-8332-983a8a2fedb4] succeeded in 3.371191941998404s: None 2024-02-23T04:53:03.844319594Z [2024-02-23 04:53:03,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5823be5f-b008-48a7-9c1b-b9f38b79fa63] succeeded in 3.6204601470017224s: None 2024-02-23T04:54:01.227167421Z [2024-02-23 04:54:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c8a9594-d70f-46b9-b8f0-7d63cd85fa73] received 2024-02-23T04:54:01.238629088Z [2024-02-23 04:54:01,238: INFO/ForkPoolWorker-15] [5c8a9594-d70f-46b9-b8f0-7d63cd85fa73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:54:01.240656228Z [2024-02-23 04:54:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b98b228-201b-4339-9b24-91038d00aa6b] received 2024-02-23T04:54:01.256160413Z [2024-02-23 04:54:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4bacb2e-319d-4ec3-b602-272cbb19cc32] received 2024-02-23T04:54:01.259100396Z [2024-02-23 04:54:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3afbd65-7810-451a-8c4a-30aa099f5f4c] received 2024-02-23T04:54:01.261045097Z [2024-02-23 04:54:01,260: INFO/ForkPoolWorker-16] [5b98b228-201b-4339-9b24-91038d00aa6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:54:01.269019841Z [2024-02-23 04:54:01,268: INFO/ForkPoolWorker-2] [c3afbd65-7810-451a-8c4a-30aa099f5f4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:54:01.281142409Z [2024-02-23 04:54:01,280: INFO/ForkPoolWorker-1] [a4bacb2e-319d-4ec3-b602-272cbb19cc32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:54:01.556847897Z [2024-02-23 04:54:01,553: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:54:01.650180901Z [2024-02-23 04:54:01,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:54:01.651384022Z [2024-02-23 04:54:01,648: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:54:01.715674285Z [2024-02-23 04:54:01,712: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:54:01.794029232Z [2024-02-23 04:54:01,793: INFO/ForkPoolWorker-16] Getting SDNC list 2024-02-23T04:54:01.800840648Z [2024-02-23 04:54:01,800: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:54:01.843116527Z [2024-02-23 04:54:01,842: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:54:01.848069863Z [2024-02-23 04:54:01,847: INFO/ForkPoolWorker-16] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:54:01.848267246Z [2024-02-23 04:54:01,847: INFO/ForkPoolWorker-16] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:54:01.848421244Z [2024-02-23 04:54:01,848: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-02-23T04:54:01.848816402Z [2024-02-23 04:54:01,848: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:54:01.959569485Z [2024-02-23 04:54:01,959: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:54:01.984810110Z [2024-02-23 04:54:01,984: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:54:02.623455830Z [2024-02-23 04:54:02,623: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b98b228-201b-4339-9b24-91038d00aa6b] succeeded in 1.3746502539979701s: None 2024-02-23T04:54:02.637383150Z [2024-02-23 04:54:02,636: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4bacb2e-319d-4ec3-b602-272cbb19cc32] succeeded in 1.3759167429998342s: None 2024-02-23T04:54:03.005077111Z [2024-02-23 04:54:03,004: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:54:03.008448941Z [2024-02-23 04:54:03,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:54:03.024317293Z [2024-02-23 04:54:03,023: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:54:03.029099667Z [2024-02-23 04:54:03,028: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:54:03.031777227Z [2024-02-23 04:54:03,031: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:54:03.033269691Z [2024-02-23 04:54:03,033: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:54:03.033348723Z [2024-02-23 04:54:03,033: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:54:03.033586281Z [2024-02-23 04:54:03,033: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:54:03.033678127Z [2024-02-23 04:54:03,033: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:54:03.034025437Z [2024-02-23 04:54:03,033: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:54:03.034181443Z [2024-02-23 04:54:03,034: INFO/ForkPoolWorker-15] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:54:03.061246277Z [2024-02-23 04:54:03,061: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:54:03.062672510Z [2024-02-23 04:54:03,062: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:54:03.062684577Z [2024-02-23 04:54:03,062: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:54:03.062952176Z [2024-02-23 04:54:03,062: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:54:03.062962124Z [2024-02-23 04:54:03,062: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:54:03.063241591Z [2024-02-23 04:54:03,063: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:54:03.063648312Z [2024-02-23 04:54:03,063: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:54:03.139205754Z [2024-02-23 04:54:03,138: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:54:03.140787594Z [2024-02-23 04:54:03,140: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:54:05.546587803Z [2024-02-23 04:54:05,546: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c8a9594-d70f-46b9-b8f0-7d63cd85fa73] succeeded in 4.316691479998553s: None 2024-02-23T04:54:05.680017564Z [2024-02-23 04:54:05,679: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c3afbd65-7810-451a-8c4a-30aa099f5f4c] succeeded in 4.419093143998907s: None 2024-02-23T04:55:01.269752422Z [2024-02-23 04:55:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[feb21a81-4eea-4bfb-9afb-1dfca65ef9ab] received 2024-02-23T04:55:01.279979376Z [2024-02-23 04:55:01,279: INFO/ForkPoolWorker-15] [feb21a81-4eea-4bfb-9afb-1dfca65ef9ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:55:01.287730119Z [2024-02-23 04:55:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4e1d94b-5dda-41b8-a379-9b126e30bf86] received 2024-02-23T04:55:01.292109494Z [2024-02-23 04:55:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9777d553-ca88-4a23-a65f-804922f307c1] received 2024-02-23T04:55:01.298035585Z [2024-02-23 04:55:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a214b94a-2c84-4a32-8f4f-6debe3553f80] received 2024-02-23T04:55:01.299381210Z [2024-02-23 04:55:01,299: INFO/ForkPoolWorker-16] [b4e1d94b-5dda-41b8-a379-9b126e30bf86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:55:01.300955003Z [2024-02-23 04:55:01,300: INFO/ForkPoolWorker-1] [9777d553-ca88-4a23-a65f-804922f307c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:55:01.319603975Z [2024-02-23 04:55:01,319: INFO/ForkPoolWorker-2] [a214b94a-2c84-4a32-8f4f-6debe3553f80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:55:01.598663936Z [2024-02-23 04:55:01,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:55:01.646343994Z [2024-02-23 04:55:01,643: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:55:01.820412628Z [2024-02-23 04:55:01,819: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:55:01.824432873Z [2024-02-23 04:55:01,823: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:01.856546355Z [2024-02-23 04:55:01,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:55:01.858601678Z [2024-02-23 04:55:01,858: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:55:01.858623376Z [2024-02-23 04:55:01,858: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:55:01.859094321Z [2024-02-23 04:55:01,858: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:55:01.859316287Z [2024-02-23 04:55:01,859: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:55:01.869926266Z [2024-02-23 04:55:01,867: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:55:01.899311060Z [2024-02-23 04:55:01,896: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:55:01.978627032Z [2024-02-23 04:55:01,978: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:02.636135419Z [2024-02-23 04:55:02,635: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9777d553-ca88-4a23-a65f-804922f307c1] succeeded in 1.3409630249989277s: None 2024-02-23T04:55:03.052819618Z [2024-02-23 04:55:03,052: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:55:03.056569127Z [2024-02-23 04:55:03,056: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:03.092950591Z [2024-02-23 04:55:03,092: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:55:03.094974674Z [2024-02-23 04:55:03,094: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:55:03.095099509Z [2024-02-23 04:55:03,094: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:55:03.095231661Z [2024-02-23 04:55:03,095: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:55:03.095297038Z [2024-02-23 04:55:03,095: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:55:03.095637256Z [2024-02-23 04:55:03,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:55:03.095676548Z [2024-02-23 04:55:03,095: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:55:03.200754264Z [2024-02-23 04:55:03,200: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:03.236990729Z [2024-02-23 04:55:03,236: INFO/ForkPoolWorker-2] Getting VIM list 2024-02-23T04:55:03.241694947Z [2024-02-23 04:55:03,241: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:03.284017875Z [2024-02-23 04:55:03,283: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:55:03.287572037Z [2024-02-23 04:55:03,287: INFO/ForkPoolWorker-2] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:55:03.287687787Z [2024-02-23 04:55:03,287: INFO/ForkPoolWorker-2] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:55:03.287881614Z [2024-02-23 04:55:03,287: INFO/ForkPoolWorker-2] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:55:03.287961069Z [2024-02-23 04:55:03,287: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-02-23T04:55:03.288306235Z [2024-02-23 04:55:03,288: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:55:03.288411715Z [2024-02-23 04:55:03,288: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:55:03.295799616Z [2024-02-23 04:55:03,295: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:55:03.299331141Z [2024-02-23 04:55:03,298: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:03.327817839Z [2024-02-23 04:55:03,327: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:55:03.332199709Z [2024-02-23 04:55:03,331: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:55:03.332228862Z [2024-02-23 04:55:03,332: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:55:03.332372623Z [2024-02-23 04:55:03,332: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:55:03.332464697Z [2024-02-23 04:55:03,332: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:55:03.332797885Z [2024-02-23 04:55:03,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:55:03.332809505Z [2024-02-23 04:55:03,332: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:55:03.373852276Z [2024-02-23 04:55:03,373: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:03.429513669Z [2024-02-23 04:55:03,429: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:03.890926685Z [2024-02-23 04:55:03,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[feb21a81-4eea-4bfb-9afb-1dfca65ef9ab] succeeded in 2.619291934002831s: None 2024-02-23T04:55:04.205897274Z [2024-02-23 04:55:04,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5eb72ef-ef06-4715-990f-2d721a24f38e] received 2024-02-23T04:55:04.213469800Z [2024-02-23 04:55:04,213: INFO/ForkPoolWorker-15] [e5eb72ef-ef06-4715-990f-2d721a24f38e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'split_metrics', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:55:04.488779015Z [2024-02-23 04:55:04,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:55:05.761604636Z [2024-02-23 04:55:05,761: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:55:05.767601990Z [2024-02-23 04:55:05,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:05.773171719Z [2024-02-23 04:55:05,772: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b4e1d94b-5dda-41b8-a379-9b126e30bf86] succeeded in 4.482847965002293s: None 2024-02-23T04:55:05.792691094Z [2024-02-23 04:55:05,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:55:05.794402060Z [2024-02-23 04:55:05,794: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:55:05.794545849Z [2024-02-23 04:55:05,794: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:55:05.794807324Z [2024-02-23 04:55:05,794: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:55:05.795010933Z [2024-02-23 04:55:05,794: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:55:05.795415175Z [2024-02-23 04:55:05,795: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:55:05.795480531Z [2024-02-23 04:55:05,795: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:55:05.903864068Z [2024-02-23 04:55:05,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:06.087997064Z [2024-02-23 04:55:06,087: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a214b94a-2c84-4a32-8f4f-6debe3553f80] succeeded in 4.787743883000076s: None 2024-02-23T04:55:06.575534073Z [2024-02-23 04:55:06,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5eb72ef-ef06-4715-990f-2d721a24f38e] succeeded in 2.3668962520023342s: None 2024-02-23T04:55:06.685903268Z [2024-02-23 04:55:06,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e517ecd-1250-467b-89fd-bbf51f93cd37] received 2024-02-23T04:55:06.701129692Z [2024-02-23 04:55:06,700: INFO/ForkPoolWorker-15] [5e517ecd-1250-467b-89fd-bbf51f93cd37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'collect_metrics', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T04:55:06.984913799Z [2024-02-23 04:55:06,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:55:08.277077978Z [2024-02-23 04:55:08,276: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:55:08.280336105Z [2024-02-23 04:55:08,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:08.303377619Z [2024-02-23 04:55:08,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:55:08.305021159Z [2024-02-23 04:55:08,304: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:55:08.305045134Z [2024-02-23 04:55:08,304: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:55:08.305195965Z [2024-02-23 04:55:08,304: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:55:08.305268066Z [2024-02-23 04:55:08,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:55:08.305678102Z [2024-02-23 04:55:08,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:55:08.305693784Z [2024-02-23 04:55:08,305: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:55:08.410519971Z [2024-02-23 04:55:08,410: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:08.978542136Z [2024-02-23 04:55:08,978: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5e517ecd-1250-467b-89fd-bbf51f93cd37] succeeded in 2.2845910899995943s: None 2024-02-23T04:55:09.121266176Z [2024-02-23 04:55:09,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b70506b0-8480-401d-a49c-f992a081bd8e] received 2024-02-23T04:55:09.143544740Z [2024-02-23 04:55:09,143: INFO/ForkPoolWorker-15] [b70506b0-8480-401d-a49c-f992a081bd8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'send_prometheus', 'scheduled__2024-02-23T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T04:55:09.429337576Z [2024-02-23 04:55:09,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-02-23T04:55:10.532514728Z [2024-02-23 04:55:10,532: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:55:10.535761754Z [2024-02-23 04:55:10,535: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:55:10.553725716Z [2024-02-23 04:55:10,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:55:10.555039393Z [2024-02-23 04:55:10,554: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:55:10.555091959Z [2024-02-23 04:55:10,554: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:55:10.555209107Z [2024-02-23 04:55:10,555: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:55:10.555279126Z [2024-02-23 04:55:10,555: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:55:10.555524594Z [2024-02-23 04:55:10,555: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-02-23T04:55:10.555580711Z [2024-02-23 04:55:10,555: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:55:10.644557176Z [2024-02-23 04:55:10,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:55:11.300025077Z [2024-02-23 04:55:11,299: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b70506b0-8480-401d-a49c-f992a081bd8e] succeeded in 2.177042193001398s: None 2024-02-23T04:56:00.480487930Z [2024-02-23 04:56:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50398bab-0045-4422-968c-0b53043fb689] received 2024-02-23T04:56:00.483632311Z [2024-02-23 04:56:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[050fbc76-f928-41ad-8109-94372bdf182b] received 2024-02-23T04:56:00.493392546Z [2024-02-23 04:56:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fa1783c-634b-485b-bbeb-429f19de8cb8] received 2024-02-23T04:56:00.495912297Z [2024-02-23 04:56:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[087da739-eca1-4747-b1d6-33b40eada196] received 2024-02-23T04:56:00.498562313Z [2024-02-23 04:56:00,498: INFO/ForkPoolWorker-16] [050fbc76-f928-41ad-8109-94372bdf182b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:56:00.500509890Z [2024-02-23 04:56:00,500: INFO/ForkPoolWorker-15] [50398bab-0045-4422-968c-0b53043fb689] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T04:56:00.502130845Z [2024-02-23 04:56:00,501: INFO/ForkPoolWorker-1] [4fa1783c-634b-485b-bbeb-429f19de8cb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:56:00.514368330Z [2024-02-23 04:56:00,514: INFO/ForkPoolWorker-2] [087da739-eca1-4747-b1d6-33b40eada196] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:56:00.855875833Z [2024-02-23 04:56:00,852: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:56:00.878539431Z [2024-02-23 04:56:00,875: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:56:00.886666927Z [2024-02-23 04:56:00,883: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:56:00.963073810Z [2024-02-23 04:56:00,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-02-23T04:56:01.109577231Z [2024-02-23 04:56:01,109: INFO/ForkPoolWorker-2] Getting SDNC list 2024-02-23T04:56:01.113589874Z [2024-02-23 04:56:01,113: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:56:01.160099702Z [2024-02-23 04:56:01,159: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-02-23T04:56:01.163756995Z [2024-02-23 04:56:01,163: INFO/ForkPoolWorker-2] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:56:01.163982146Z [2024-02-23 04:56:01,163: INFO/ForkPoolWorker-2] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:56:01.164167816Z [2024-02-23 04:56:01,164: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-02-23T04:56:01.164586360Z [2024-02-23 04:56:01,164: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:56:01.255185436Z [2024-02-23 04:56:01,254: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:56:01.339753115Z [2024-02-23 04:56:01,339: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:56:02.040114946Z [2024-02-23 04:56:02,039: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50398bab-0045-4422-968c-0b53043fb689] succeeded in 1.5582698740035994s: None 2024-02-23T04:56:02.042477243Z [2024-02-23 04:56:02,041: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[087da739-eca1-4747-b1d6-33b40eada196] succeeded in 1.5447418539988576s: None 2024-02-23T04:56:02.262797326Z [2024-02-23 04:56:02,262: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:56:02.267060096Z [2024-02-23 04:56:02,266: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:56:02.292034458Z [2024-02-23 04:56:02,291: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:56:02.293915474Z [2024-02-23 04:56:02,293: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:56:02.294084356Z [2024-02-23 04:56:02,293: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:56:02.294106596Z [2024-02-23 04:56:02,293: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:56:02.294170340Z [2024-02-23 04:56:02,294: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:56:02.294545251Z [2024-02-23 04:56:02,294: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:56:02.294703363Z [2024-02-23 04:56:02,294: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:56:02.344836995Z [2024-02-23 04:56:02,344: INFO/ForkPoolWorker-1] Getting VIM list 2024-02-23T04:56:02.348604052Z [2024-02-23 04:56:02,348: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:56:02.381042049Z [2024-02-23 04:56:02,380: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:56:02.385172269Z [2024-02-23 04:56:02,384: INFO/ForkPoolWorker-1] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:56:02.386682169Z [2024-02-23 04:56:02,386: INFO/ForkPoolWorker-1] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:56:02.386914597Z [2024-02-23 04:56:02,386: INFO/ForkPoolWorker-1] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:56:02.387006768Z [2024-02-23 04:56:02,386: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-02-23T04:56:02.387379848Z [2024-02-23 04:56:02,387: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:56:02.387393839Z [2024-02-23 04:56:02,387: INFO/ForkPoolWorker-1] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:56:02.393721943Z [2024-02-23 04:56:02,393: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:56:02.499656306Z [2024-02-23 04:56:02,499: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:56:04.875693593Z [2024-02-23 04:56:04,875: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[050fbc76-f928-41ad-8109-94372bdf182b] succeeded in 4.388481688998581s: None 2024-02-23T04:56:05.078658438Z [2024-02-23 04:56:05,078: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4fa1783c-634b-485b-bbeb-429f19de8cb8] succeeded in 4.581444527000713s: None 2024-02-23T04:57:00.848575822Z [2024-02-23 04:57:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17ce125f-a6b3-42dc-b761-f81f9bf796a1] received 2024-02-23T04:57:00.855346406Z [2024-02-23 04:57:00,855: INFO/ForkPoolWorker-15] [17ce125f-a6b3-42dc-b761-f81f9bf796a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T04:57:00.864197290Z [2024-02-23 04:57:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[972b62d7-f893-4166-8a5d-d7ebc6f17415] received 2024-02-23T04:57:00.866873538Z [2024-02-23 04:57:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32ea071d-9d63-4105-ab5f-bf64c7ea85f7] received 2024-02-23T04:57:00.877568062Z [2024-02-23 04:57:00,877: INFO/ForkPoolWorker-16] [972b62d7-f893-4166-8a5d-d7ebc6f17415] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T04:57:00.891221285Z [2024-02-23 04:57:00,890: INFO/ForkPoolWorker-1] [32ea071d-9d63-4105-ab5f-bf64c7ea85f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T04:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T04:57:01.260368853Z [2024-02-23 04:57:01,257: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-02-23T04:57:01.336829727Z [2024-02-23 04:57:01,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-02-23T04:57:01.340628812Z [2024-02-23 04:57:01,336: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-02-23T04:57:01.517682284Z [2024-02-23 04:57:01,517: INFO/ForkPoolWorker-1] Getting SDNC list 2024-02-23T04:57:01.521862005Z [2024-02-23 04:57:01,521: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:57:01.543502560Z [2024-02-23 04:57:01,543: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-02-23T04:57:01.544465231Z [2024-02-23 04:57:01,544: INFO/ForkPoolWorker-1] Read SDNC b692db83-27a3-4be0-9685-c7bae73d6bde (sdnc-osm) 2024-02-23T04:57:01.544543764Z [2024-02-23 04:57:01,544: INFO/ForkPoolWorker-1] [{'_id': 'b692db83-27a3-4be0-9685-c7bae73d6bde', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-02-23T04:57:01.544618236Z [2024-02-23 04:57:01,544: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-02-23T04:57:01.544884123Z [2024-02-23 04:57:01,544: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_b692db83-27a3-4be0-9685-c7bae73d6bde 2024-02-23T04:57:01.652101102Z [2024-02-23 04:57:01,648: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:57:02.384307464Z [2024-02-23 04:57:02,383: INFO/ForkPoolWorker-16] Getting VIM list 2024-02-23T04:57:02.393047248Z [2024-02-23 04:57:02,392: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32ea071d-9d63-4105-ab5f-bf64c7ea85f7] succeeded in 1.5227836230005778s: None 2024-02-23T04:57:02.397196840Z [2024-02-23 04:57:02,396: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:57:02.417308939Z [2024-02-23 04:57:02,417: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-02-23T04:57:02.418916179Z [2024-02-23 04:57:02,418: INFO/ForkPoolWorker-16] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:57:02.419409568Z [2024-02-23 04:57:02,419: INFO/ForkPoolWorker-16] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:57:02.419576044Z [2024-02-23 04:57:02,419: INFO/ForkPoolWorker-16] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:57:02.419667971Z [2024-02-23 04:57:02,419: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-02-23T04:57:02.419986569Z [2024-02-23 04:57:02,419: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-02-23T04:57:02.420081790Z [2024-02-23 04:57:02,419: INFO/ForkPoolWorker-16] Creating DAG vim_status_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:57:02.487365407Z [2024-02-23 04:57:02,486: INFO/ForkPoolWorker-15] Getting VIM list 2024-02-23T04:57:02.490554682Z [2024-02-23 04:57:02,490: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ifsMvOxJjNAy5Jrb007PanExZGfkxXqs'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-02-23T04:57:02.499577976Z [2024-02-23 04:57:02,499: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:57:02.516137030Z [2024-02-23 04:57:02,515: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-02-23T04:57:02.517515642Z [2024-02-23 04:57:02,517: INFO/ForkPoolWorker-15] Read VIM 2ff877dc-ab8f-4c0b-b97a-2113705a63d7 (_system-osm-vim) 2024-02-23T04:57:02.517613808Z [2024-02-23 04:57:02,517: INFO/ForkPoolWorker-15] Read VIM ffc29d71-6d3f-4f69-b2ad-14ef5e840757 (osm) 2024-02-23T04:57:02.517824636Z [2024-02-23 04:57:02,517: INFO/ForkPoolWorker-15] [{'_id': '2ff877dc-ab8f-4c0b-b97a-2113705a63d7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ffc29d71-6d3f-4f69-b2ad-14ef5e840757', 'name': 'osm', 'vim_type': 'openstack'}] 2024-02-23T04:57:02.517970995Z [2024-02-23 04:57:02,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-02-23T04:57:02.518250744Z [2024-02-23 04:57:02,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-02-23T04:57:02.518298272Z [2024-02-23 04:57:02,518: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ffc29d71-6d3f-4f69-b2ad-14ef5e840757 2024-02-23T04:57:02.596023053Z [2024-02-23 04:57:02,595: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-02-23T04:57:05.073215971Z [2024-02-23 04:57:05,072: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[972b62d7-f893-4166-8a5d-d7ebc6f17415] succeeded in 4.202660500999627s: None 2024-02-23T04:57:06.199556548Z [2024-02-23 04:57:06,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17ce125f-a6b3-42dc-b761-f81f9bf796a1] succeeded in 5.351666120001028s: None 2024-02-22T23:32:03.039937750Z 2024-02-22T23:32:03.046073923Z Cleaning logs every 900 seconds 2024-02-22T23:32:03.046091967Z Trimming airflow logs to 15 days. 2024-02-22T23:45:00.156169438Z Trimming airflow logs to 15 days. 2024-02-22T23:45:01.188174638Z Trimming airflow logs to 15 days. 2024-02-23T00:00:00.227985774Z Trimming airflow logs to 15 days. 2024-02-23T00:00:01.260978004Z Trimming airflow logs to 15 days. 2024-02-23T00:15:00.313469698Z Trimming airflow logs to 15 days. 2024-02-23T00:15:01.356923826Z Trimming airflow logs to 15 days. 2024-02-23T00:30:00.424184002Z Trimming airflow logs to 15 days. 2024-02-23T00:30:01.472260284Z Trimming airflow logs to 15 days. 2024-02-23T00:45:00.546503722Z Trimming airflow logs to 15 days. 2024-02-23T00:45:01.584944657Z Trimming airflow logs to 15 days. 2024-02-23T01:00:00.665862176Z Trimming airflow logs to 15 days. 2024-02-23T01:00:01.718687496Z Trimming airflow logs to 15 days. 2024-02-23T01:15:00.785767497Z Trimming airflow logs to 15 days. 2024-02-23T01:15:01.851151756Z Trimming airflow logs to 15 days. 2024-02-23T01:30:00.923156627Z Trimming airflow logs to 15 days. 2024-02-23T01:30:01.993462205Z Trimming airflow logs to 15 days. 2024-02-23T01:45:00.066304275Z Trimming airflow logs to 15 days. 2024-02-23T01:45:01.143655264Z Trimming airflow logs to 15 days. 2024-02-23T02:00:00.235487186Z Trimming airflow logs to 15 days. 2024-02-23T02:00:01.311261137Z Trimming airflow logs to 15 days. 2024-02-23T02:15:00.397282216Z Trimming airflow logs to 15 days. 2024-02-23T02:15:01.469983204Z Trimming airflow logs to 15 days. 2024-02-23T02:30:00.668043957Z Trimming airflow logs to 15 days. 2024-02-23T02:30:01.748794565Z Trimming airflow logs to 15 days. 2024-02-23T02:45:00.862073353Z Trimming airflow logs to 15 days. 2024-02-23T02:45:01.966556252Z Trimming airflow logs to 15 days. 2024-02-23T03:00:00.075420278Z Trimming airflow logs to 15 days. 2024-02-23T03:00:01.207431901Z Trimming airflow logs to 15 days. 2024-02-23T03:15:00.312356974Z Trimming airflow logs to 15 days. 2024-02-23T03:15:01.399760510Z Trimming airflow logs to 15 days. 2024-02-23T03:30:00.551040415Z Trimming airflow logs to 15 days. 2024-02-23T03:30:01.647118697Z Trimming airflow logs to 15 days. 2024-02-23T03:45:00.764347616Z Trimming airflow logs to 15 days. 2024-02-23T03:45:01.847674394Z Trimming airflow logs to 15 days. 2024-02-23T04:00:00.959270727Z Trimming airflow logs to 15 days. 2024-02-23T04:15:00.151523302Z Trimming airflow logs to 15 days. 2024-02-23T04:15:01.267125478Z Trimming airflow logs to 15 days. 2024-02-23T04:30:00.384837726Z Trimming airflow logs to 15 days. 2024-02-23T04:30:01.507120220Z Trimming airflow logs to 15 days. 2024-02-23T04:45:00.635274051Z Trimming airflow logs to 15 days. 2024-02-23T04:45:01.737069337Z Trimming airflow logs to 15 days.